Nov 30 10:43:31 user nova-compute[75020]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75020) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 10:43:31 user nova-compute[75020]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75020) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 10:43:31 user nova-compute[75020]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75020) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 10:43:31 user nova-compute[75020]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 30 10:43:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:43:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:43:32 user nova-compute[75020]: INFO nova.virt.driver [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 30 10:43:32 user nova-compute[75020]: INFO nova.compute.provider_config [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] Acquiring lock "singleton_lock" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] Acquired lock "singleton_lock" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] Releasing lock "singleton_lock" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] Full set of CONF: {{(pid=75020) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ******************************************************************************** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] Configuration options gathered from: {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ================================================================================ {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] allow_resize_to_same_host      = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] arq_binding_timeout            = 300 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] backdoor_port                  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] backdoor_socket                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] block_device_allocate_retries  = 300 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] block_device_allocate_retries_interval = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cert                           = self.pem {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute_monitors               = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] config_dir                     = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] config_drive_format            = iso9660 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] config_source                  = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] console_host                   = user {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] control_exchange               = nova {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cpu_allocation_ratio           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] daemon                         = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] debug                          = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] default_access_ip_network_name = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] default_availability_zone      = nova {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] default_ephemeral_format       = ext4 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] default_green_pool_size        = 1000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] default_schedule_zone          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] disk_allocation_ratio          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] enable_new_services            = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] enabled_ssl_apis               = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] flat_injected                  = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] force_config_drive             = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] force_raw_images               = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] graceful_shutdown_timeout      = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] heal_instance_info_cache_interval = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] host                           = user {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] instance_build_timeout         = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] instance_delete_interval       = 300 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] instance_name_template         = instance-%08x {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] instance_usage_audit           = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] instance_usage_audit_period    = month {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] internal_service_availability_zone = internal {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] key                            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] live_migration_retry_count     = 30 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] log_config_append              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] log_dir                        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] log_file                       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] log_options                    = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] log_rotate_interval            = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] log_rotate_interval_type       = days {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] log_rotation_type              = none {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] long_rpc_timeout               = 1800 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] max_concurrent_builds          = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] max_concurrent_live_migrations = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] max_concurrent_snapshots       = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] max_local_block_devices        = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] max_logfile_count              = 30 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] max_logfile_size_mb            = 200 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] maximum_instance_delete_attempts = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] metadata_listen                = 0.0.0.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] metadata_listen_port           = 8775 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] metadata_workers               = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] migrate_max_retries            = -1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] mkisofs_cmd                    = genisoimage {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] my_ip                          = 10.0.0.210 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] network_allocate_retries       = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] osapi_compute_listen_port      = 8774 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] osapi_compute_unique_server_name_scope =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] osapi_compute_workers          = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] password_length                = 12 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] periodic_enable                = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] periodic_fuzzy_delay           = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] pointer_model                  = ps2mouse {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] preallocate_images             = none {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] publish_errors                 = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] pybasedir                      = /opt/stack/nova {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ram_allocation_ratio           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] rate_limit_burst               = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] rate_limit_except_level        = CRITICAL {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] rate_limit_interval            = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] reboot_timeout                 = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] reclaim_instance_interval      = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] record                         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] reimage_timeout_per_gb         = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] report_interval                = 120 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] rescue_timeout                 = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] reserved_host_cpus             = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] reserved_host_disk_mb          = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] reserved_host_memory_mb        = 512 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] reserved_huge_pages            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] resize_confirm_window          = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] resize_fs_using_block_device   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] resume_guests_state_on_host_boot = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] rpc_response_timeout           = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] run_external_periodic_tasks    = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] running_deleted_instance_action = reap {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] running_deleted_instance_timeout = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler_instance_sync_interval = 120 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_down_time              = 720 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] servicegroup_driver            = db {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] shelved_offload_time           = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] shelved_poll_interval          = 3600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] shutdown_timeout               = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] source_is_ipv6                 = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ssl_only                       = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] state_path                     = /opt/stack/data/nova {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] sync_power_state_interval      = 600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] sync_power_state_pool_size     = 1000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] syslog_log_facility            = LOG_USER {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] tempdir                        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] timeout_nbd                    = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] transport_url                  = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] update_resources_interval      = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] use_cow_images                 = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] use_eventlog                   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] use_journal                    = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] use_json                       = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] use_rootwrap_daemon            = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] use_stderr                     = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] use_syslog                     = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vcpu_pin_set                   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plugging_is_fatal          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plugging_timeout           = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] virt_mkfs                      = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] volume_usage_poll_interval     = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] watch_log_file                 = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] web                            = /usr/share/spice-html5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.auth_strategy              = keystone {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.compute_link_prefix        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.dhcp_domain                = novalocal {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.enable_instance_password   = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.glance_link_prefix         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.instance_list_per_project_cells = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.list_records_by_skipping_down_cells = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.local_metadata_per_cell    = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.max_limit                  = 1000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.metadata_cache_expiration  = 15 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.neutron_default_tenant_id  = default {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.use_forwarded_for          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.use_neutron_default_nets   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.vendordata_dynamic_targets = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.vendordata_jsonfile_path   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.backend_argument         = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.config_prefix            = cache.oslo {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.dead_timeout             = 60.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.debug_cache_backend      = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.enable_retry_client      = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.enable_socket_keepalive  = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.enabled                  = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.expiration_time          = 600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_dead_retry      = 300 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_password        =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_sasl_enabled    = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.memcache_username        =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.proxies                  = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.retry_attempts           = 2 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.retry_delay              = 0.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.socket_keepalive_count   = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.socket_keepalive_idle    = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.socket_keepalive_interval = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.tls_allowed_ciphers      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.tls_cafile               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.tls_certfile             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.tls_enabled              = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cache.tls_keyfile              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.auth_section            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.auth_type               = password {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.cafile                  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.certfile                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.collect_timing          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.cross_az_attach         = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.debug                   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.endpoint_template       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.http_retries            = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.insecure                = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.keyfile                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.os_region_name          = RegionOne {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.split_loggers           = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cinder.timeout                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.cpu_dedicated_set      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.cpu_shared_set         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.image_type_exclude_list = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.resource_provider_association_refresh = 300 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.shutdown_retry_interval = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] conductor.workers              = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] console.allowed_origins        = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] console.ssl_ciphers            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] console.ssl_minimum_version    = default {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] consoleauth.token_ttl          = 600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.cafile                  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.certfile                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.collect_timing          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.connect_retries         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.connect_retry_delay     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.endpoint_override       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.insecure                = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.keyfile                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.max_version             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.min_version             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.region_name             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.service_name            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.service_type            = accelerator {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.split_loggers           = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.status_code_retries     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.status_code_retry_delay = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.timeout                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] cyborg.version                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.backend               = sqlalchemy {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.connection            = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.connection_debug      = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.connection_parameters =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.connection_recycle_time = 3600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.connection_trace      = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.db_inc_retry_interval = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.db_max_retries        = 20 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.db_max_retry_interval = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.db_retry_interval     = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.max_overflow          = 50 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.max_pool_size         = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.max_retries           = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.pool_timeout          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.retry_interval        = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.slave_connection      = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] database.sqlite_synchronous    = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.backend           = sqlalchemy {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.connection        = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.connection_debug  = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.connection_parameters =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.connection_recycle_time = 3600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.connection_trace  = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.db_inc_retry_interval = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.db_max_retries    = 20 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.db_max_retry_interval = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.db_retry_interval = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.max_overflow      = 50 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.max_pool_size     = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.max_retries       = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.pool_timeout      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.retry_interval    = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.slave_connection  = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] api_database.sqlite_synchronous = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] devices.enabled_mdev_types     = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ephemeral_storage_encryption.enabled = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.api_servers             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.cafile                  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.certfile                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.collect_timing          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.connect_retries         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.connect_retry_delay     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.debug                   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.default_trusted_certificate_ids = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.enable_certificate_validation = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.enable_rbd_download     = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.endpoint_override       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.insecure                = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.keyfile                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.max_version             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.min_version             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.num_retries             = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.rbd_ceph_conf           =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.rbd_connect_timeout     = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.rbd_pool                =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.rbd_user                =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.region_name             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.service_name            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.service_type            = image {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.split_loggers           = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.status_code_retries     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.status_code_retry_delay = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.timeout                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.verify_glance_signatures = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] glance.version                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] guestfs.debug                  = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.config_drive_cdrom      = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.config_drive_inject_password = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.enable_remotefx         = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.instances_path_share    =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.limit_cpu_features      = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.use_multipath_io        = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.vswitch_name            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] mks.enabled                    = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] image_cache.manager_interval   = 2400 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] image_cache.precache_concurrency = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] image_cache.remove_unused_base_images = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] image_cache.subdirectory_name  = _base {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.api_max_retries         = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.api_retry_interval      = 2 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.auth_section            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.auth_type               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.cafile                  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.certfile                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.collect_timing          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.conductor_group         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.connect_retries         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.connect_retry_delay     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.endpoint_override       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.insecure                = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.keyfile                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.max_version             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.min_version             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.peer_list               = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.region_name             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.serial_console_state_timeout = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.service_name            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.service_type            = baremetal {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.split_loggers           = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.status_code_retries     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.status_code_retry_delay = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.timeout                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ironic.version                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] key_manager.fixed_key          = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.barbican_api_version  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.barbican_endpoint     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.barbican_endpoint_type = public {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.barbican_region_name  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.cafile                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.certfile              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.collect_timing        = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.insecure              = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.keyfile               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.number_of_retries     = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.retry_delay           = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.send_service_user_token = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.split_loggers         = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.timeout               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.verify_ssl            = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican.verify_ssl_path       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.auth_section = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.auth_type = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.cafile   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.certfile = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.collect_timing = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.insecure = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.keyfile  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.split_loggers = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] barbican_service_user.timeout  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.approle_role_id          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.approle_secret_id        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.cafile                   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.certfile                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.collect_timing           = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.insecure                 = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.keyfile                  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.kv_mountpoint            = secret {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.kv_path                  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.kv_version               = 2 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.namespace                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.root_token_id            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.split_loggers            = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.ssl_ca_crt_file          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.timeout                  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.use_ssl                  = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.auth_section          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.auth_type             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.cafile                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.certfile              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.collect_timing        = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.connect_retries       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.connect_retry_delay   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.endpoint_override     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.insecure              = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.keyfile               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.max_version           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.min_version           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.region_name           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.service_name          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.service_type          = identity {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.split_loggers         = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.status_code_retries   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.status_code_retry_delay = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.timeout               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] keystone.version               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.connection_uri         =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.cpu_mode               = custom {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: WARNING oslo_config.cfg [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.cpu_power_governor_high = performance {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.cpu_power_management   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.device_detach_attempts = 8 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.device_detach_timeout  = 20 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.disk_cachemodes        = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.disk_prefix            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.enabled_perf_events    = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.file_backed_memory     = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.gid_maps               = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.hw_disk_discard        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.hw_machine_type        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.images_rbd_pool        = rbd {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.images_type            = default {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.images_volume_group    = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.inject_key             = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.inject_partition       = -2 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.inject_password        = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.iscsi_iface            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.iser_use_multipath     = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_downtime = 500 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_inbound_addr = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_scheme  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_timeout_action = abort {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_tunnelled = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: WARNING oslo_config.cfg [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 30 10:43:32 user nova-compute[75020]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 30 10:43:32 user nova-compute[75020]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 30 10:43:32 user nova-compute[75020]: and ``live_migration_inbound_addr`` respectively.
Nov 30 10:43:32 user nova-compute[75020]: ).  Its value may be silently ignored in the future.
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.live_migration_with_native_tls = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.max_queues             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.nfs_mount_options      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.num_pcie_ports         = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.pmem_namespaces        = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.quobyte_client_cfg     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rbd_secret_uuid        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rbd_user               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rescue_image_id        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rescue_kernel_id       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.rx_queue_size          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.smbfs_mount_options    =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.snapshot_compression   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.snapshot_image_format  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.sparse_logical_volumes = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.swtpm_enabled          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.swtpm_group            = tss {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.swtpm_user             = tss {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.sysinfo_serial         = unique {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.tb_cache_size          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.tx_queue_size          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.uid_maps               = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.use_virtio_for_bridges = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.virt_type              = kvm {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.volume_clear           = zero {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.volume_clear_size      = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.volume_use_multipath   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.vzstorage_cache_path   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.auth_section           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.auth_type              = password {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.cafile                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.certfile               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.collect_timing         = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.connect_retries        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.connect_retry_delay    = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.default_floating_pool  = public {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.endpoint_override      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.extension_sync_interval = 600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.http_retries           = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.insecure               = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.keyfile                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.max_version            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.min_version            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.ovs_bridge             = br-int {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.physnets               = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.region_name            = RegionOne {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.service_metadata_proxy = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.service_name           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.service_type           = network {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.split_loggers          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.status_code_retries    = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.status_code_retry_delay = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.timeout                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] neutron.version                = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] notifications.bdms_in_notifications = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] notifications.default_level    = INFO {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] notifications.notification_format = unversioned {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] notifications.notify_on_state_change = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] pci.alias                      = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] pci.device_spec                = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] pci.report_in_placement        = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.auth_section         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.auth_type            = password {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.cafile               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.certfile             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.collect_timing       = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.connect_retries      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.connect_retry_delay  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.default_domain_id    = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.default_domain_name  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.domain_id            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.domain_name          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.endpoint_override    = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.insecure             = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.keyfile              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.max_version          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.min_version          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.password             = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.project_domain_id    = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.project_domain_name  = Default {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.project_id           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.project_name         = service {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.region_name          = RegionOne {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.service_name         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.service_type         = placement {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.split_loggers        = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.status_code_retries  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.status_code_retry_delay = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.system_scope         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.timeout              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.trust_id             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.user_domain_id       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.user_domain_name     = Default {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.user_id              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.username             = placement {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] placement.version              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.cores                    = 20 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.count_usage_from_placement = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.injected_file_content_bytes = 10240 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.injected_file_path_length = 255 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.injected_files           = 5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.instances                = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.key_pairs                = 100 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.metadata_items           = 128 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.ram                      = 51200 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.recheck_quota            = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.server_group_members     = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] quota.server_groups            = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] rdp.enabled                    = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.image_metadata_prefilter = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.max_attempts         = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.max_placement_results = 1000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] scheduler.workers              = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.host_subset_size = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.isolated_hosts = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.isolated_images = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.pci_in_placement = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.track_instance_changes = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] metrics.required               = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] metrics.weight_multiplier      = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] metrics.weight_setting         = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] serial_console.enabled         = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] serial_console.port_range      = 10000:20000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] serial_console.serialproxy_port = 6083 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.auth_section      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.auth_type         = password {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.cafile            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.certfile          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.collect_timing    = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.insecure          = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.keyfile           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.send_service_user_token = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.split_loggers     = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] service_user.timeout           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.agent_enabled            = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.enabled                  = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.html5proxy_port          = 6082 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.image_compression        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.jpeg_compression         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.playback_compression     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.server_listen            = 127.0.0.1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.streaming_mode           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] spice.zlib_compression         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] upgrade_levels.baseapi         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] upgrade_levels.compute         = auto {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] upgrade_levels.conductor       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] upgrade_levels.scheduler       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.cafile = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.certfile = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.insecure = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vendordata_dynamic_auth.timeout = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.api_retry_count         = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.ca_file                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.cache_prefix            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.cluster_name            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.connection_pool_size    = 10 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.console_delay_seconds   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.datastore_regex         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.host_ip                 = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.host_password           = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.host_port               = 443 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.host_username           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.insecure                = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.integration_bridge      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.maximum_objects         = 100 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.pbm_default_policy      = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.pbm_enabled             = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.pbm_wsdl_location       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.serial_port_proxy_uri   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.serial_port_service_uri = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.task_poll_interval      = 0.5 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.use_linked_clone        = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.vnc_keymap              = en-us {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.vnc_port                = 5900 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vmware.vnc_port_total          = 10000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.auth_schemes               = ['none'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.enabled                    = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.novncproxy_port            = 6080 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.vencrypt_ca_certs          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.vencrypt_client_cert       = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vnc.vencrypt_client_key        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.disable_rootwrap   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.enable_numa_live_migration = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.libvirt_disable_apic = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.client_socket_timeout     = 900 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.default_pool_size         = 1000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.keep_alive                = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.max_header_line           = 16384 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.ssl_ca_file               = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.ssl_cert_file             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.ssl_key_file              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.tcp_keepidle              = 600 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] zvm.ca_file                    = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] zvm.cloud_connector_url        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] zvm.reachable_timeout          = 300 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.enforce_scope      = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.policy_default_rule = default {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.connection_string     = messaging:// {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.enabled               = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.es_doc_type           = notification {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.es_scroll_size        = 10000 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.es_scroll_time        = 2m {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.filter_error_trace    = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.hmac_keys             = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.sentinel_service_name = mymaster {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.socket_timeout        = 0.1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.trace_requests        = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler.trace_sqlalchemy      = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler_jaeger.process_tags   = {} {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] profiler_otlp.service_name_prefix = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] remote_debug.host              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] remote_debug.port              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.auth_section        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.auth_type           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.cafile              = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.certfile            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.collect_timing      = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.connect_retries     = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.connect_retry_delay = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.endpoint_id         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.endpoint_override   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.insecure            = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.keyfile             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.max_version         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.min_version         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.region_name         = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.service_name        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.service_type        = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.split_loggers       = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.status_code_retries = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.status_code_retry_delay = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.timeout             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.valid_interfaces    = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_limit.version             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_reports.file_event_handler = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] oslo_reports.log_dir           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_ovs_privileged.group  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] vif_plug_ovs_privileged.user   = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_ovs.isolate_vif         = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] os_brick.lock_path             = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] privsep_osbrick.capabilities   = [21] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] privsep_osbrick.group          = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] privsep_osbrick.helper_command = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] privsep_osbrick.user           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] nova_sys_admin.group           = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] nova_sys_admin.helper_command  = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] nova_sys_admin.user            = None {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG oslo_service.service [None req-055704d6-4583-49c3-b938-c6df97b76cc9 None None] ******************************************************************************** {{(pid=75020) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 30 10:43:32 user nova-compute[75020]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 30 10:43:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Connecting to libvirt: qemu:///system {{(pid=75020) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fadb9cc62f0> {{(pid=75020) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 30 10:43:32 user nova-compute[75020]: libvirt:  error : internal error: could not initialize domain event timer
Nov 30 10:43:32 user nova-compute[75020]: WARNING nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 30 10:43:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fadb9cc62f0> {{(pid=75020) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Starting native event thread {{(pid=75020) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Starting green dispatch thread {{(pid=75020) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 30 10:43:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Starting connection event dispatch thread {{(pid=75020) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 30 10:43:32 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Connection event '1' reason 'None'
Nov 30 10:43:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 10:43:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.mount [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Initialising _HostMountState generation 0 {{(pid=75020) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 30 10:43:40 user nova-compute[75020]: INFO nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host capabilities <capabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <host>
Nov 30 10:43:40 user nova-compute[75020]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 30 10:43:40 user nova-compute[75020]:     <cpu>
Nov 30 10:43:40 user nova-compute[75020]:       <arch>x86_64</arch>
Nov 30 10:43:40 user nova-compute[75020]:       <model>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <microcode version='1070'/>
Nov 30 10:43:40 user nova-compute[75020]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 30 10:43:40 user nova-compute[75020]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='osxsave'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='invtsc'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='rsba'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature name='skip-l1dfl-vmentry'/>
Nov 30 10:43:40 user nova-compute[75020]:       <pages unit='KiB' size='4'/>
Nov 30 10:43:40 user nova-compute[75020]:       <pages unit='KiB' size='2048'/>
Nov 30 10:43:40 user nova-compute[75020]:     </cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <power_management>
Nov 30 10:43:40 user nova-compute[75020]:       <suspend_mem/>
Nov 30 10:43:40 user nova-compute[75020]:       <suspend_disk/>
Nov 30 10:43:40 user nova-compute[75020]:       <suspend_hybrid/>
Nov 30 10:43:40 user nova-compute[75020]:     </power_management>
Nov 30 10:43:40 user nova-compute[75020]:     <iommu support='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <migration_features>
Nov 30 10:43:40 user nova-compute[75020]:       <live/>
Nov 30 10:43:40 user nova-compute[75020]:       <uri_transports>
Nov 30 10:43:40 user nova-compute[75020]:         <uri_transport>tcp</uri_transport>
Nov 30 10:43:40 user nova-compute[75020]:         <uri_transport>rdma</uri_transport>
Nov 30 10:43:40 user nova-compute[75020]:       </uri_transports>
Nov 30 10:43:40 user nova-compute[75020]:     </migration_features>
Nov 30 10:43:40 user nova-compute[75020]:     <topology>
Nov 30 10:43:40 user nova-compute[75020]:       <cells num='2'>
Nov 30 10:43:40 user nova-compute[75020]:         <cell id='0'>
Nov 30 10:43:40 user nova-compute[75020]:           <memory unit='KiB'>8140616</memory>
Nov 30 10:43:40 user nova-compute[75020]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 30 10:43:40 user nova-compute[75020]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 10:43:40 user nova-compute[75020]:           <distances>
Nov 30 10:43:40 user nova-compute[75020]:             <sibling id='0' value='10'/>
Nov 30 10:43:40 user nova-compute[75020]:             <sibling id='1' value='20'/>
Nov 30 10:43:40 user nova-compute[75020]:           </distances>
Nov 30 10:43:40 user nova-compute[75020]:           <cpus num='6'>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 30 10:43:40 user nova-compute[75020]:           </cpus>
Nov 30 10:43:40 user nova-compute[75020]:         </cell>
Nov 30 10:43:40 user nova-compute[75020]:         <cell id='1'>
Nov 30 10:43:40 user nova-compute[75020]:           <memory unit='KiB'>8255068</memory>
Nov 30 10:43:40 user nova-compute[75020]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 30 10:43:40 user nova-compute[75020]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 10:43:40 user nova-compute[75020]:           <distances>
Nov 30 10:43:40 user nova-compute[75020]:             <sibling id='0' value='20'/>
Nov 30 10:43:40 user nova-compute[75020]:             <sibling id='1' value='10'/>
Nov 30 10:43:40 user nova-compute[75020]:           </distances>
Nov 30 10:43:40 user nova-compute[75020]:           <cpus num='6'>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 30 10:43:40 user nova-compute[75020]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 30 10:43:40 user nova-compute[75020]:           </cpus>
Nov 30 10:43:40 user nova-compute[75020]:         </cell>
Nov 30 10:43:40 user nova-compute[75020]:       </cells>
Nov 30 10:43:40 user nova-compute[75020]:     </topology>
Nov 30 10:43:40 user nova-compute[75020]:     <cache>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 30 10:43:40 user nova-compute[75020]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 30 10:43:40 user nova-compute[75020]:     </cache>
Nov 30 10:43:40 user nova-compute[75020]:     <secmodel>
Nov 30 10:43:40 user nova-compute[75020]:       <model>apparmor</model>
Nov 30 10:43:40 user nova-compute[75020]:       <doi>0</doi>
Nov 30 10:43:40 user nova-compute[75020]:     </secmodel>
Nov 30 10:43:40 user nova-compute[75020]:     <secmodel>
Nov 30 10:43:40 user nova-compute[75020]:       <model>dac</model>
Nov 30 10:43:40 user nova-compute[75020]:       <doi>0</doi>
Nov 30 10:43:40 user nova-compute[75020]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 30 10:43:40 user nova-compute[75020]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 30 10:43:40 user nova-compute[75020]:     </secmodel>
Nov 30 10:43:40 user nova-compute[75020]:   </host>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='alpha'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>clipper</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='armv6l'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>spitz</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>nuri</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>kzm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sx1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>z2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>tosa</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>n810</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>n800</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>terrier</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>midway</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>microbit</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>verdex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>highbank</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>akita</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>connex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>collie</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='armv7l'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>spitz</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>nuri</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>kzm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sx1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>z2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>tosa</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>n810</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>n800</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>terrier</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>midway</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>microbit</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>verdex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>highbank</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>akita</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>connex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>collie</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='aarch64'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>spitz</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>nuri</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>kzm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sx1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>z2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>tosa</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>n810</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>n800</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>terrier</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>midway</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>microbit</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>verdex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>raspi3b</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>highbank</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>akita</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>connex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>collie</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <acpi default='on' toggle='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='cris'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='i686'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>isapc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>microvm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='kvm'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <pae/>
Nov 30 10:43:40 user nova-compute[75020]:       <nonpae/>
Nov 30 10:43:40 user nova-compute[75020]:       <acpi default='on' toggle='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:       <apic default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='m68k'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>an5206</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>q800</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>next-cube</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='microblaze'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='microblazeel'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='mips'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='16'>malta</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='mipsel'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='16'>malta</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='mips64'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='16'>malta</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>pica61</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>magnum</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='mips64el'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='16'>malta</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>pica61</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>magnum</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='16'>boston</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='ppc'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mac99</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>40p</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>taihu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='ppc64'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>taihu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>40p</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mac99</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='ppc64le'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>taihu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>40p</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>mac99</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='riscv32'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='8'>spike</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>opentitan</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='8'>virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='riscv64'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='8'>spike</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>shakti_c</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='8'>virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='s390x'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='sh4'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>shix</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>r2d</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='sh4eb'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>shix</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>r2d</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='sparc'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>SS-5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>SS-20</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>LX</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>SS-4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>SS-10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>Voyager</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='sparc64'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sun4u</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>niagara</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>sun4v</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='x86_64'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>64</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='1'>isapc</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>microvm</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='kvm'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <acpi default='on' toggle='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:       <apic default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='xtensa'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>sim</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>kc705</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>ml605</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>lx200</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>lx60</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]:   <guest>
Nov 30 10:43:40 user nova-compute[75020]:     <os_type>hvm</os_type>
Nov 30 10:43:40 user nova-compute[75020]:     <arch name='xtensaeb'>
Nov 30 10:43:40 user nova-compute[75020]:       <wordsize>32</wordsize>
Nov 30 10:43:40 user nova-compute[75020]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='4'>sim</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>kc705</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>ml605</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>virt</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>lx200</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>lx60</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 10:43:40 user nova-compute[75020]:       <domain type='qemu'/>
Nov 30 10:43:40 user nova-compute[75020]:     </arch>
Nov 30 10:43:40 user nova-compute[75020]:     <features>
Nov 30 10:43:40 user nova-compute[75020]:       <cpuselection/>
Nov 30 10:43:40 user nova-compute[75020]:       <deviceboot/>
Nov 30 10:43:40 user nova-compute[75020]:       <disksnapshot default='on' toggle='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     </features>
Nov 30 10:43:40 user nova-compute[75020]:   </guest>
Nov 30 10:43:40 user nova-compute[75020]: </capabilities>
Nov 30 10:43:40 user nova-compute[75020]: 
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 30 10:43:40 user nova-compute[75020]: <domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 10:43:40 user nova-compute[75020]:   <domain>kvm</domain>
Nov 30 10:43:40 user nova-compute[75020]:   <machine>pc-q35-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:   <arch>i686</arch>
Nov 30 10:43:40 user nova-compute[75020]:   <vcpu max='288'/>
Nov 30 10:43:40 user nova-compute[75020]:   <iothreads supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:   <os supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='firmware'/>
Nov 30 10:43:40 user nova-compute[75020]:     <loader supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>rom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pflash</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='readonly'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='secure'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </loader>
Nov 30 10:43:40 user nova-compute[75020]:   </os>
Nov 30 10:43:40 user nova-compute[75020]:   <cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-passthrough' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='hostPassthroughMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='maximum' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='maximumMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-model' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='umip'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibpb'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibrs'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='erms'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='lm'/>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='custom' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>qemu64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>qemu32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>phenom</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>n270</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>kvm64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>coreduo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>core2duo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>athlon</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Westmere</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Snowridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Penryn</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G5</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G4</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G1</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Rome</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Milan</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Dhyana</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cooperlake</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Conroe</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>486</model>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:   </cpu>
Nov 30 10:43:40 user nova-compute[75020]:   <memoryBacking supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='sourceType'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>file</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>anonymous</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>memfd</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:   </memoryBacking>
Nov 30 10:43:40 user nova-compute[75020]:   <devices>
Nov 30 10:43:40 user nova-compute[75020]:     <disk supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='diskDevice'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>disk</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cdrom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>floppy</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>lun</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='bus'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>fdc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sata</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </disk>
Nov 30 10:43:40 user nova-compute[75020]:     <graphics supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sdl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vnc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>spice</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egl-headless</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </graphics>
Nov 30 10:43:40 user nova-compute[75020]:     <video supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='modelType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cirrus</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vmvga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>qxl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>none</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>bochs</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ramfb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </video>
Nov 30 10:43:40 user nova-compute[75020]:     <hostdev supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='mode'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>subsystem</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='startupPolicy'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>default</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>mandatory</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>requisite</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>optional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='subsysType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pci</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='capsType'/>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='pciBackend'/>
Nov 30 10:43:40 user nova-compute[75020]:     </hostdev>
Nov 30 10:43:40 user nova-compute[75020]:     <rng supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>random</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egd</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>builtin</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </rng>
Nov 30 10:43:40 user nova-compute[75020]:     <filesystem supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='driverType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>path</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>handle</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtiofs</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </filesystem>
Nov 30 10:43:40 user nova-compute[75020]:     <tpm supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-tis</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-crb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>passthrough</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>emulator</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </tpm>
Nov 30 10:43:40 user nova-compute[75020]:   </devices>
Nov 30 10:43:40 user nova-compute[75020]:   <features>
Nov 30 10:43:40 user nova-compute[75020]:     <gic supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <vmcoreinfo supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <genid supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backingStoreInput supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backup supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <sev supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:   </features>
Nov 30 10:43:40 user nova-compute[75020]: </domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 30 10:43:40 user nova-compute[75020]: <domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 10:43:40 user nova-compute[75020]:   <domain>kvm</domain>
Nov 30 10:43:40 user nova-compute[75020]:   <machine>pc-q35-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:   <arch>i686</arch>
Nov 30 10:43:40 user nova-compute[75020]:   <vcpu max='288'/>
Nov 30 10:43:40 user nova-compute[75020]:   <iothreads supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:   <os supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='firmware'/>
Nov 30 10:43:40 user nova-compute[75020]:     <loader supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>rom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pflash</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='readonly'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='secure'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </loader>
Nov 30 10:43:40 user nova-compute[75020]:   </os>
Nov 30 10:43:40 user nova-compute[75020]:   <cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-passthrough' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='hostPassthroughMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='maximum' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='maximumMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-model' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='umip'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibpb'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibrs'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='erms'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='lm'/>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='custom' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>qemu64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>qemu32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>phenom</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>n270</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>kvm64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>coreduo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>core2duo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>athlon</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Westmere</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Snowridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Penryn</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G5</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G4</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G1</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Rome</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Milan</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Dhyana</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cooperlake</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Conroe</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>486</model>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:   </cpu>
Nov 30 10:43:40 user nova-compute[75020]:   <memoryBacking supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='sourceType'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>file</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>anonymous</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>memfd</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:   </memoryBacking>
Nov 30 10:43:40 user nova-compute[75020]:   <devices>
Nov 30 10:43:40 user nova-compute[75020]:     <disk supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='diskDevice'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>disk</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cdrom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>floppy</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>lun</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='bus'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>fdc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sata</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </disk>
Nov 30 10:43:40 user nova-compute[75020]:     <graphics supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sdl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vnc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>spice</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egl-headless</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </graphics>
Nov 30 10:43:40 user nova-compute[75020]:     <video supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='modelType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cirrus</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vmvga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>qxl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>none</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>bochs</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ramfb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </video>
Nov 30 10:43:40 user nova-compute[75020]:     <hostdev supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='mode'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>subsystem</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='startupPolicy'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>default</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>mandatory</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>requisite</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>optional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='subsysType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pci</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='capsType'/>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='pciBackend'/>
Nov 30 10:43:40 user nova-compute[75020]:     </hostdev>
Nov 30 10:43:40 user nova-compute[75020]:     <rng supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>random</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egd</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>builtin</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </rng>
Nov 30 10:43:40 user nova-compute[75020]:     <filesystem supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='driverType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>path</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>handle</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtiofs</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </filesystem>
Nov 30 10:43:40 user nova-compute[75020]:     <tpm supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-tis</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-crb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>passthrough</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>emulator</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </tpm>
Nov 30 10:43:40 user nova-compute[75020]:   </devices>
Nov 30 10:43:40 user nova-compute[75020]:   <features>
Nov 30 10:43:40 user nova-compute[75020]:     <gic supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <vmcoreinfo supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <genid supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backingStoreInput supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backup supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <sev supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:   </features>
Nov 30 10:43:40 user nova-compute[75020]: </domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 30 10:43:40 user nova-compute[75020]: <domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 10:43:40 user nova-compute[75020]:   <domain>kvm</domain>
Nov 30 10:43:40 user nova-compute[75020]:   <machine>pc-i440fx-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:   <arch>i686</arch>
Nov 30 10:43:40 user nova-compute[75020]:   <vcpu max='255'/>
Nov 30 10:43:40 user nova-compute[75020]:   <iothreads supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:   <os supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='firmware'/>
Nov 30 10:43:40 user nova-compute[75020]:     <loader supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>rom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pflash</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='readonly'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='secure'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </loader>
Nov 30 10:43:40 user nova-compute[75020]:   </os>
Nov 30 10:43:40 user nova-compute[75020]:   <cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-passthrough' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='hostPassthroughMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='maximum' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='maximumMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-model' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='umip'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibpb'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibrs'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='erms'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='lm'/>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='custom' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>qemu64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>qemu32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>phenom</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>n270</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>kvm64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>coreduo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>core2duo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>athlon</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Westmere</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Snowridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Penryn</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G5</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G4</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G1</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Rome</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Milan</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Dhyana</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cooperlake</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Conroe</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>486</model>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:   </cpu>
Nov 30 10:43:40 user nova-compute[75020]:   <memoryBacking supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='sourceType'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>file</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>anonymous</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>memfd</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:   </memoryBacking>
Nov 30 10:43:40 user nova-compute[75020]:   <devices>
Nov 30 10:43:40 user nova-compute[75020]:     <disk supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='diskDevice'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>disk</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cdrom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>floppy</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>lun</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='bus'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ide</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>fdc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sata</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </disk>
Nov 30 10:43:40 user nova-compute[75020]:     <graphics supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sdl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vnc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>spice</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egl-headless</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </graphics>
Nov 30 10:43:40 user nova-compute[75020]:     <video supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='modelType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cirrus</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vmvga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>qxl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>none</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>bochs</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ramfb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </video>
Nov 30 10:43:40 user nova-compute[75020]:     <hostdev supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='mode'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>subsystem</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='startupPolicy'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>default</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>mandatory</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>requisite</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>optional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='subsysType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pci</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='capsType'/>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='pciBackend'/>
Nov 30 10:43:40 user nova-compute[75020]:     </hostdev>
Nov 30 10:43:40 user nova-compute[75020]:     <rng supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>random</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egd</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>builtin</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </rng>
Nov 30 10:43:40 user nova-compute[75020]:     <filesystem supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='driverType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>path</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>handle</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtiofs</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </filesystem>
Nov 30 10:43:40 user nova-compute[75020]:     <tpm supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-tis</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-crb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>passthrough</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>emulator</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </tpm>
Nov 30 10:43:40 user nova-compute[75020]:   </devices>
Nov 30 10:43:40 user nova-compute[75020]:   <features>
Nov 30 10:43:40 user nova-compute[75020]:     <gic supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <vmcoreinfo supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <genid supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backingStoreInput supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backup supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <sev supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:   </features>
Nov 30 10:43:40 user nova-compute[75020]: </domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 30 10:43:40 user nova-compute[75020]: <domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 10:43:40 user nova-compute[75020]:   <domain>kvm</domain>
Nov 30 10:43:40 user nova-compute[75020]:   <machine>pc-i440fx-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:   <arch>i686</arch>
Nov 30 10:43:40 user nova-compute[75020]:   <vcpu max='255'/>
Nov 30 10:43:40 user nova-compute[75020]:   <iothreads supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:   <os supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='firmware'/>
Nov 30 10:43:40 user nova-compute[75020]:     <loader supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>rom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pflash</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='readonly'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='secure'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </loader>
Nov 30 10:43:40 user nova-compute[75020]:   </os>
Nov 30 10:43:40 user nova-compute[75020]:   <cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-passthrough' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='hostPassthroughMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='maximum' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='maximumMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-model' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='umip'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibpb'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibrs'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='erms'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='lm'/>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='custom' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>qemu64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>qemu32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>phenom</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>n270</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>kvm64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>coreduo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>core2duo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>athlon</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Westmere</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Snowridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Penryn</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G5</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G4</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G1</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Rome</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Milan</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Dhyana</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cooperlake</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Conroe</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>486</model>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:   </cpu>
Nov 30 10:43:40 user nova-compute[75020]:   <memoryBacking supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='sourceType'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>file</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>anonymous</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>memfd</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:   </memoryBacking>
Nov 30 10:43:40 user nova-compute[75020]:   <devices>
Nov 30 10:43:40 user nova-compute[75020]:     <disk supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='diskDevice'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>disk</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cdrom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>floppy</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>lun</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='bus'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ide</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>fdc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sata</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </disk>
Nov 30 10:43:40 user nova-compute[75020]:     <graphics supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sdl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vnc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>spice</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egl-headless</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </graphics>
Nov 30 10:43:40 user nova-compute[75020]:     <video supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='modelType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cirrus</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vmvga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>qxl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>none</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>bochs</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ramfb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </video>
Nov 30 10:43:40 user nova-compute[75020]:     <hostdev supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='mode'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>subsystem</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='startupPolicy'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>default</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>mandatory</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>requisite</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>optional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='subsysType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pci</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='capsType'/>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='pciBackend'/>
Nov 30 10:43:40 user nova-compute[75020]:     </hostdev>
Nov 30 10:43:40 user nova-compute[75020]:     <rng supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>random</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egd</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>builtin</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </rng>
Nov 30 10:43:40 user nova-compute[75020]:     <filesystem supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='driverType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>path</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>handle</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtiofs</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </filesystem>
Nov 30 10:43:40 user nova-compute[75020]:     <tpm supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-tis</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-crb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>passthrough</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>emulator</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </tpm>
Nov 30 10:43:40 user nova-compute[75020]:   </devices>
Nov 30 10:43:40 user nova-compute[75020]:   <features>
Nov 30 10:43:40 user nova-compute[75020]:     <gic supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <vmcoreinfo supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <genid supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backingStoreInput supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backup supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <sev supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:   </features>
Nov 30 10:43:40 user nova-compute[75020]: </domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 30 10:43:40 user nova-compute[75020]: <domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 10:43:40 user nova-compute[75020]:   <domain>kvm</domain>
Nov 30 10:43:40 user nova-compute[75020]:   <machine>pc-q35-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:   <arch>x86_64</arch>
Nov 30 10:43:40 user nova-compute[75020]:   <vcpu max='288'/>
Nov 30 10:43:40 user nova-compute[75020]:   <iothreads supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:   <os supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='firmware'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>efi</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:     <loader supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>rom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pflash</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='readonly'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='secure'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </loader>
Nov 30 10:43:40 user nova-compute[75020]:   </os>
Nov 30 10:43:40 user nova-compute[75020]:   <cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-passthrough' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='hostPassthroughMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='maximum' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='maximumMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-model' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='umip'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='invtsc'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibpb'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibrs'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='rsba'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='erms'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='custom' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>qemu64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>qemu32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>phenom</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>n270</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>coreduo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>core2duo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>athlon</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Westmere</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Snowridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Penryn</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G5</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G4</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Opteron_G1</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Rome</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Milan</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Dhyana</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cooperlake</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Conroe</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>486</model>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:   </cpu>
Nov 30 10:43:40 user nova-compute[75020]:   <memoryBacking supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='sourceType'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>file</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>anonymous</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>memfd</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:   </memoryBacking>
Nov 30 10:43:40 user nova-compute[75020]:   <devices>
Nov 30 10:43:40 user nova-compute[75020]:     <disk supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='diskDevice'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>disk</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cdrom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>floppy</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>lun</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='bus'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>fdc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sata</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </disk>
Nov 30 10:43:40 user nova-compute[75020]:     <graphics supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sdl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vnc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>spice</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egl-headless</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </graphics>
Nov 30 10:43:40 user nova-compute[75020]:     <video supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='modelType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cirrus</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vmvga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>qxl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>none</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>bochs</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ramfb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </video>
Nov 30 10:43:40 user nova-compute[75020]:     <hostdev supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='mode'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>subsystem</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='startupPolicy'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>default</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>mandatory</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>requisite</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>optional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='subsysType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pci</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='capsType'/>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='pciBackend'/>
Nov 30 10:43:40 user nova-compute[75020]:     </hostdev>
Nov 30 10:43:40 user nova-compute[75020]:     <rng supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>random</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egd</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>builtin</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </rng>
Nov 30 10:43:40 user nova-compute[75020]:     <filesystem supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='driverType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>path</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>handle</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtiofs</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </filesystem>
Nov 30 10:43:40 user nova-compute[75020]:     <tpm supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-tis</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-crb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>passthrough</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>emulator</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </tpm>
Nov 30 10:43:40 user nova-compute[75020]:   </devices>
Nov 30 10:43:40 user nova-compute[75020]:   <features>
Nov 30 10:43:40 user nova-compute[75020]:     <gic supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <vmcoreinfo supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <genid supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backingStoreInput supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backup supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <sev supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:   </features>
Nov 30 10:43:40 user nova-compute[75020]: </domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 30 10:43:40 user nova-compute[75020]: <domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 10:43:40 user nova-compute[75020]:   <domain>kvm</domain>
Nov 30 10:43:40 user nova-compute[75020]:   <machine>pc-q35-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:   <arch>x86_64</arch>
Nov 30 10:43:40 user nova-compute[75020]:   <vcpu max='288'/>
Nov 30 10:43:40 user nova-compute[75020]:   <iothreads supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:   <os supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='firmware'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>efi</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:     <loader supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>rom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pflash</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='readonly'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='secure'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </loader>
Nov 30 10:43:40 user nova-compute[75020]:   </os>
Nov 30 10:43:40 user nova-compute[75020]:   <cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-passthrough' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='hostPassthroughMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='maximum' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='maximumMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-model' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='umip'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='invtsc'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibpb'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibrs'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='rsba'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='erms'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='custom' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>qemu64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>qemu32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>phenom</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>n270</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>coreduo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>core2duo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>athlon</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Westmere</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Snowridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Penryn</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G5</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G4</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Opteron_G1</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Rome</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Milan</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Dhyana</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cooperlake</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Conroe</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>486</model>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:   </cpu>
Nov 30 10:43:40 user nova-compute[75020]:   <memoryBacking supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='sourceType'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>file</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>anonymous</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>memfd</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:   </memoryBacking>
Nov 30 10:43:40 user nova-compute[75020]:   <devices>
Nov 30 10:43:40 user nova-compute[75020]:     <disk supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='diskDevice'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>disk</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cdrom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>floppy</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>lun</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='bus'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>fdc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sata</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </disk>
Nov 30 10:43:40 user nova-compute[75020]:     <graphics supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sdl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vnc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>spice</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egl-headless</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </graphics>
Nov 30 10:43:40 user nova-compute[75020]:     <video supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='modelType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cirrus</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vmvga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>qxl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>none</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>bochs</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ramfb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </video>
Nov 30 10:43:40 user nova-compute[75020]:     <hostdev supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='mode'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>subsystem</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='startupPolicy'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>default</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>mandatory</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>requisite</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>optional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='subsysType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pci</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='capsType'/>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='pciBackend'/>
Nov 30 10:43:40 user nova-compute[75020]:     </hostdev>
Nov 30 10:43:40 user nova-compute[75020]:     <rng supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>random</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egd</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>builtin</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </rng>
Nov 30 10:43:40 user nova-compute[75020]:     <filesystem supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='driverType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>path</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>handle</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtiofs</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </filesystem>
Nov 30 10:43:40 user nova-compute[75020]:     <tpm supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-tis</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-crb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>passthrough</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>emulator</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </tpm>
Nov 30 10:43:40 user nova-compute[75020]:   </devices>
Nov 30 10:43:40 user nova-compute[75020]:   <features>
Nov 30 10:43:40 user nova-compute[75020]:     <gic supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <vmcoreinfo supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <genid supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backingStoreInput supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backup supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <sev supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:   </features>
Nov 30 10:43:40 user nova-compute[75020]: </domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 30 10:43:40 user nova-compute[75020]: <domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 10:43:40 user nova-compute[75020]:   <domain>kvm</domain>
Nov 30 10:43:40 user nova-compute[75020]:   <machine>pc-i440fx-6.2</machine>
Nov 30 10:43:40 user nova-compute[75020]:   <arch>x86_64</arch>
Nov 30 10:43:40 user nova-compute[75020]:   <vcpu max='255'/>
Nov 30 10:43:40 user nova-compute[75020]:   <iothreads supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:   <os supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='firmware'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>efi</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:     <loader supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>rom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pflash</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='readonly'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='secure'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </loader>
Nov 30 10:43:40 user nova-compute[75020]:   </os>
Nov 30 10:43:40 user nova-compute[75020]:   <cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-passthrough' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='hostPassthroughMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='maximum' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='maximumMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-model' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='umip'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='invtsc'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibpb'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibrs'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='rsba'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='erms'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='custom' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>qemu64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>qemu32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>phenom</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>n270</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>coreduo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>core2duo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>athlon</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Westmere</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Snowridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Penryn</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G5</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G4</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Opteron_G1</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Rome</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Milan</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Dhyana</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cooperlake</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Conroe</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>486</model>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:   </cpu>
Nov 30 10:43:40 user nova-compute[75020]:   <memoryBacking supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='sourceType'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>file</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>anonymous</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>memfd</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:   </memoryBacking>
Nov 30 10:43:40 user nova-compute[75020]:   <devices>
Nov 30 10:43:40 user nova-compute[75020]:     <disk supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='diskDevice'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>disk</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cdrom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>floppy</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>lun</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='bus'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ide</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>fdc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sata</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </disk>
Nov 30 10:43:40 user nova-compute[75020]:     <graphics supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sdl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vnc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>spice</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egl-headless</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </graphics>
Nov 30 10:43:40 user nova-compute[75020]:     <video supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='modelType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cirrus</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vmvga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>qxl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>none</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>bochs</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ramfb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </video>
Nov 30 10:43:40 user nova-compute[75020]:     <hostdev supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='mode'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>subsystem</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='startupPolicy'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>default</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>mandatory</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>requisite</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>optional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='subsysType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pci</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='capsType'/>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='pciBackend'/>
Nov 30 10:43:40 user nova-compute[75020]:     </hostdev>
Nov 30 10:43:40 user nova-compute[75020]:     <rng supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>random</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egd</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>builtin</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </rng>
Nov 30 10:43:40 user nova-compute[75020]:     <filesystem supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='driverType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>path</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>handle</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtiofs</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </filesystem>
Nov 30 10:43:40 user nova-compute[75020]:     <tpm supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-tis</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-crb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>passthrough</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>emulator</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </tpm>
Nov 30 10:43:40 user nova-compute[75020]:   </devices>
Nov 30 10:43:40 user nova-compute[75020]:   <features>
Nov 30 10:43:40 user nova-compute[75020]:     <gic supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <vmcoreinfo supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <genid supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backingStoreInput supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backup supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <sev supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:   </features>
Nov 30 10:43:40 user nova-compute[75020]: </domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 30 10:43:40 user nova-compute[75020]: <domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 10:43:40 user nova-compute[75020]:   <domain>kvm</domain>
Nov 30 10:43:40 user nova-compute[75020]:   <machine>pc-i440fx-jammy</machine>
Nov 30 10:43:40 user nova-compute[75020]:   <arch>x86_64</arch>
Nov 30 10:43:40 user nova-compute[75020]:   <vcpu max='255'/>
Nov 30 10:43:40 user nova-compute[75020]:   <iothreads supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:   <os supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='firmware'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>efi</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:     <loader supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>rom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pflash</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='readonly'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>yes</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='secure'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>no</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </loader>
Nov 30 10:43:40 user nova-compute[75020]:   </os>
Nov 30 10:43:40 user nova-compute[75020]:   <cpu>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-passthrough' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='hostPassthroughMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='maximum' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='maximumMigratable'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>on</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>off</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='host-model' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <vendor>Intel</vendor>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ss'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='vmx'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pcid'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='hypervisor'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arat'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='umip'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='md-clear'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='invtsc'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibpb'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='ibrs'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-stibp'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='rsba'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='erms'/>
Nov 30 10:43:40 user nova-compute[75020]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:     <mode name='custom' supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>qemu64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>qemu32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>phenom</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>pentium</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>n270</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm64</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>kvm32</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>coreduo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>core2duo</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>athlon</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Westmere</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Snowridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Skylake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>SandyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Penryn</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G5</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G4</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G3</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Opteron_G2</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Opteron_G1</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>IvyBridge</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Icelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Haswell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Rome</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-Milan</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>EPYC</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Dhyana</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cooperlake</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>Conroe</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='no'>Broadwell</model>
Nov 30 10:43:40 user nova-compute[75020]:       <model usable='yes'>486</model>
Nov 30 10:43:40 user nova-compute[75020]:     </mode>
Nov 30 10:43:40 user nova-compute[75020]:   </cpu>
Nov 30 10:43:40 user nova-compute[75020]:   <memoryBacking supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:     <enum name='sourceType'>
Nov 30 10:43:40 user nova-compute[75020]:       <value>file</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>anonymous</value>
Nov 30 10:43:40 user nova-compute[75020]:       <value>memfd</value>
Nov 30 10:43:40 user nova-compute[75020]:     </enum>
Nov 30 10:43:40 user nova-compute[75020]:   </memoryBacking>
Nov 30 10:43:40 user nova-compute[75020]:   <devices>
Nov 30 10:43:40 user nova-compute[75020]:     <disk supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='diskDevice'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>disk</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cdrom</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>floppy</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>lun</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='bus'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ide</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>fdc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sata</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </disk>
Nov 30 10:43:40 user nova-compute[75020]:     <graphics supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='type'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>sdl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vnc</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>spice</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egl-headless</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </graphics>
Nov 30 10:43:40 user nova-compute[75020]:     <video supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='modelType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>cirrus</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>vmvga</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>qxl</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>none</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>bochs</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>ramfb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </video>
Nov 30 10:43:40 user nova-compute[75020]:     <hostdev supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='mode'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>subsystem</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='startupPolicy'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>default</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>mandatory</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>requisite</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>optional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='subsysType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>usb</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>pci</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>scsi</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='capsType'/>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='pciBackend'/>
Nov 30 10:43:40 user nova-compute[75020]:     </hostdev>
Nov 30 10:43:40 user nova-compute[75020]:     <rng supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtio-non-transitional</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>random</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>egd</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>builtin</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </rng>
Nov 30 10:43:40 user nova-compute[75020]:     <filesystem supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='driverType'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>path</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>handle</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>virtiofs</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </filesystem>
Nov 30 10:43:40 user nova-compute[75020]:     <tpm supported='yes'>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='model'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-tis</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>tpm-crb</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:       <enum name='backendModel'>
Nov 30 10:43:40 user nova-compute[75020]:         <value>passthrough</value>
Nov 30 10:43:40 user nova-compute[75020]:         <value>emulator</value>
Nov 30 10:43:40 user nova-compute[75020]:       </enum>
Nov 30 10:43:40 user nova-compute[75020]:     </tpm>
Nov 30 10:43:40 user nova-compute[75020]:   </devices>
Nov 30 10:43:40 user nova-compute[75020]:   <features>
Nov 30 10:43:40 user nova-compute[75020]:     <gic supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:     <vmcoreinfo supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <genid supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backingStoreInput supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <backup supported='yes'/>
Nov 30 10:43:40 user nova-compute[75020]:     <sev supported='no'/>
Nov 30 10:43:40 user nova-compute[75020]:   </features>
Nov 30 10:43:40 user nova-compute[75020]: </domainCapabilities>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75020) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75020) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Checking secure boot support for host arch (x86_64) {{(pid=75020) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 30 10:43:40 user nova-compute[75020]: INFO nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Secure Boot support detected
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] cpu compare xml: <cpu match="exact">
Nov 30 10:43:40 user nova-compute[75020]:   <model>Nehalem</model>
Nov 30 10:43:40 user nova-compute[75020]: </cpu>
Nov 30 10:43:40 user nova-compute[75020]:  {{(pid=75020) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 30 10:43:40 user nova-compute[75020]: INFO nova.virt.node [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Generated node identity 88367873-990b-4954-a4a6-b7b412a97446
Nov 30 10:43:40 user nova-compute[75020]: INFO nova.virt.node [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Wrote node identity 88367873-990b-4954-a4a6-b7b412a97446 to /opt/stack/data/nova/compute_id
Nov 30 10:43:40 user nova-compute[75020]: WARNING nova.compute.manager [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Compute nodes ['88367873-990b-4954-a4a6-b7b412a97446'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 30 10:43:40 user nova-compute[75020]: INFO nova.compute.manager [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 30 10:43:40 user nova-compute[75020]: WARNING nova.compute.manager [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 10:43:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:43:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:43:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Hypervisor/Node resource view: name=user free_ram=10965MB free_disk=26.231773376464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:43:40 user nova-compute[75020]: WARNING nova.compute.resource_tracker [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] No compute node record for user:88367873-990b-4954-a4a6-b7b412a97446: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 88367873-990b-4954-a4a6-b7b412a97446 could not be found.
Nov 30 10:43:40 user nova-compute[75020]: INFO nova.compute.resource_tracker [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Compute node record created for user:user with uuid: 88367873-990b-4954-a4a6-b7b412a97446
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:43:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:43:41 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] [req-861be8cd-3fbe-400d-a56c-6e2f58893af6] Created resource provider record via placement API for resource provider with UUID 88367873-990b-4954-a4a6-b7b412a97446 and name user.
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75020) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 30 10:43:41 user nova-compute[75020]: INFO nova.virt.libvirt.host [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] kernel doesn't support AMD SEV
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Libvirt baseline CPU <cpu>
Nov 30 10:43:41 user nova-compute[75020]:   <arch>x86_64</arch>
Nov 30 10:43:41 user nova-compute[75020]:   <model>Nehalem</model>
Nov 30 10:43:41 user nova-compute[75020]:   <vendor>Intel</vendor>
Nov 30 10:43:41 user nova-compute[75020]:   <topology sockets="6" cores="1" threads="1"/>
Nov 30 10:43:41 user nova-compute[75020]: </cpu>
Nov 30 10:43:41 user nova-compute[75020]:  {{(pid=75020) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Updated inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Updating resource provider 88367873-990b-4954-a4a6-b7b412a97446 generation from 0 to 1 during operation: update_inventory {{(pid=75020) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Updating resource provider 88367873-990b-4954-a4a6-b7b412a97446 generation from 1 to 2 during operation: update_traits {{(pid=75020) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.714s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.service [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Creating RPC server for service compute {{(pid=75020) start /opt/stack/nova/nova/service.py:182}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.service [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] Join ServiceGroup membership for this service compute {{(pid=75020) start /opt/stack/nova/nova/service.py:199}}
Nov 30 10:43:41 user nova-compute[75020]: DEBUG nova.servicegroup.drivers.db [None req-c92b0fa0-28db-49f5-8856-4cefc8637a1f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75020) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 30 10:44:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:44:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:44:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=10395MB free_disk=26.135604858398438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:44:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:45:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:33 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:45:34 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:45:34 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=10317MB free_disk=26.199859619140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:45:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:46:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:46:35 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:46:35 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:46:35 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=10343MB free_disk=25.952224731445312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:46:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:46:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:46:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:46:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:46:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:47:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:47:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9632MB free_disk=25.972557067871094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:47:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:47:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:47:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:47:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:47:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:47:42 user nova-compute[75020]: INFO nova.compute.claims [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Claim successful on node user
Nov 30 10:47:42 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:47:42 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:47:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:47:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:47:42 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:47:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:47:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:47:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Creating image(s)
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "/opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "/opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "/opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG nova.policy [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a93ae25dec664c44ba88b0f15f6a239e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02acda28c914dcdaa8afa65411b8055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG nova.virt.images [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] a0e347bf-fa3a-4008-b934-b96aa4570396 was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814.part /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814.part /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814.converted" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.976s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:44 user nova-compute[75020]: INFO oslo.privsep.daemon [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpar8fab3o/privsep.sock']
Nov 30 10:47:44 user sudo[84268]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpar8fab3o/privsep.sock
Nov 30 10:47:44 user sudo[84268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 10:47:45 user sudo[84268]: pam_unix(sudo:session): session closed for user root
Nov 30 10:47:45 user nova-compute[75020]: INFO oslo.privsep.daemon [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Spawned new privsep daemon via rootwrap
Nov 30 10:47:45 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 10:47:45 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 10:47:45 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 30 10:47:45 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84285
Nov 30 10:47:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:47:46 user nova-compute[75020]: INFO nova.compute.claims [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Claim successful on node user
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.167s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk 1073741824" returned: 0 in 0.067s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.167s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.260s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:47:46 user nova-compute[75020]: INFO nova.compute.claims [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Claim successful on node user
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Cannot resize image /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Ensure instance console log exists: /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:47:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:47:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Creating image(s)
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.policy [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007e7cb60a1540c0a4168b27b2c92e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2765886644e4b5eb42a29eb8c0a82e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Successfully created port: f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:47:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.170s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:47:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Creating image(s)
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "/opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "/opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "/opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.215s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.policy [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0beedde307a4b06abb0dd9141d208e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d45560c8a2642bd8c079763d52047e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk 1073741824" returned: 0 in 0.046s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.167s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk 1073741824" returned: 0 in 0.043s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Cannot resize image /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Ensure instance console log exists: /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:47:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Cannot resize image /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Ensure instance console log exists: /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:48 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:47:48 user nova-compute[75020]: INFO nova.compute.claims [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Claim successful on node user
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:47:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Successfully created port: a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:47:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Creating image(s)
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "/opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "/opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.policy [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f64ef255b2a48349a280bf3693af23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10919b523b740859f3ac98e31468a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Successfully created port: d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk 1073741824" returned: 0 in 0.054s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Cannot resize image /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Ensure instance console log exists: /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Successfully updated port: f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquired lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:47:50 user nova-compute[75020]: INFO nova.compute.claims [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Claim successful on node user
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-595937ee-a53f-4636-aafb-26920a1f1a8d req-2a780ecf-e5fe-449d-8363-e6f9cfad1cae service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received event network-changed-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-595937ee-a53f-4636-aafb-26920a1f1a8d req-2a780ecf-e5fe-449d-8363-e6f9cfad1cae service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Refreshing instance network info cache due to event network-changed-f756ed97-6717-4f69-b7ea-3e503a0d7bf2. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-595937ee-a53f-4636-aafb-26920a1f1a8d req-2a780ecf-e5fe-449d-8363-e6f9cfad1cae service nova] Acquiring lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:47:50 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:47:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:47:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Creating image(s)
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.policy [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d431a8177f54de08c3d0c03a3c9ff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0cce29854643d0b730dc664697dee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.202s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Successfully created port: a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updating instance_info_cache with network_info: [{"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Releasing lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Instance network_info: |[{"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-595937ee-a53f-4636-aafb-26920a1f1a8d req-2a780ecf-e5fe-449d-8363-e6f9cfad1cae service nova] Acquired lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.network.neutron [req-595937ee-a53f-4636-aafb-26920a1f1a8d req-2a780ecf-e5fe-449d-8363-e6f9cfad1cae service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Refreshing network info cache for port f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Start _get_guest_xml network_info=[{"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:47:51 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:51 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2135448650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2135448650',id=1,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-vybt0vmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:43Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=d88214a8-f7f1-4735-8faf-611d70a77d9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:41:9c,bridge_name='br-int',has_traffic_filtering=True,id=f756ed97-6717-4f69-b7ea-3e503a0d7bf2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf756ed97-67') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'pci_devices' on Instance uuid d88214a8-f7f1-4735-8faf-611d70a77d9f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:47:51 user nova-compute[75020]:   <uuid>d88214a8-f7f1-4735-8faf-611d70a77d9f</uuid>
Nov 30 10:47:51 user nova-compute[75020]:   <name>instance-00000001</name>
Nov 30 10:47:51 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:47:51 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:47:51 user nova-compute[75020]:   <metadata>
Nov 30 10:47:51 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:47:51 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:47:51 user nova-compute[75020]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2135448650</nova:name>
Nov 30 10:47:51 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:47:51</nova:creationTime>
Nov 30 10:47:51 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:47:51 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:47:51 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:47:51 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:47:51 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:47:51 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:47:51 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:47:51 user nova-compute[75020]:       <nova:owner>
Nov 30 10:47:51 user nova-compute[75020]:         <nova:user uuid="a93ae25dec664c44ba88b0f15f6a239e">tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member</nova:user>
Nov 30 10:47:51 user nova-compute[75020]:         <nova:project uuid="e02acda28c914dcdaa8afa65411b8055">tempest-ServerBootFromVolumeStableRescueTest-548019548</nova:project>
Nov 30 10:47:51 user nova-compute[75020]:       </nova:owner>
Nov 30 10:47:51 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:47:51 user nova-compute[75020]:       <nova:ports>
Nov 30 10:47:51 user nova-compute[75020]:         <nova:port uuid="f756ed97-6717-4f69-b7ea-3e503a0d7bf2">
Nov 30 10:47:51 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 10:47:51 user nova-compute[75020]:         </nova:port>
Nov 30 10:47:51 user nova-compute[75020]:       </nova:ports>
Nov 30 10:47:51 user nova-compute[75020]:     </nova:instance>
Nov 30 10:47:51 user nova-compute[75020]:   </metadata>
Nov 30 10:47:51 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:47:51 user nova-compute[75020]:     <system>
Nov 30 10:47:51 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:47:51 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:47:51 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:47:51 user nova-compute[75020]:       <entry name="serial">d88214a8-f7f1-4735-8faf-611d70a77d9f</entry>
Nov 30 10:47:51 user nova-compute[75020]:       <entry name="uuid">d88214a8-f7f1-4735-8faf-611d70a77d9f</entry>
Nov 30 10:47:51 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:47:51 user nova-compute[75020]:     </system>
Nov 30 10:47:51 user nova-compute[75020]:   </sysinfo>
Nov 30 10:47:51 user nova-compute[75020]:   <os>
Nov 30 10:47:51 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:47:51 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:47:51 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:47:51 user nova-compute[75020]:   </os>
Nov 30 10:47:51 user nova-compute[75020]:   <features>
Nov 30 10:47:51 user nova-compute[75020]:     <acpi/>
Nov 30 10:47:51 user nova-compute[75020]:     <apic/>
Nov 30 10:47:51 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:47:51 user nova-compute[75020]:   </features>
Nov 30 10:47:51 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:47:51 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:47:51 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:47:51 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:47:51 user nova-compute[75020]:   </clock>
Nov 30 10:47:51 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:47:51 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:47:51 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:47:51 user nova-compute[75020]:   </cpu>
Nov 30 10:47:51 user nova-compute[75020]:   <devices>
Nov 30 10:47:51 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:47:51 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:47:51 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk"/>
Nov 30 10:47:51 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:47:51 user nova-compute[75020]:     </disk>
Nov 30 10:47:51 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:47:51 user nova-compute[75020]:       <mac address="fa:16:3e:87:41:9c"/>
Nov 30 10:47:51 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:51 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:47:51 user nova-compute[75020]:       <target dev="tapf756ed97-67"/>
Nov 30 10:47:51 user nova-compute[75020]:     </interface>
Nov 30 10:47:51 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:47:51 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/console.log" append="off"/>
Nov 30 10:47:51 user nova-compute[75020]:     </serial>
Nov 30 10:47:51 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:47:51 user nova-compute[75020]:     <video>
Nov 30 10:47:51 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:51 user nova-compute[75020]:     </video>
Nov 30 10:47:51 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:47:51 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:47:51 user nova-compute[75020]:     </rng>
Nov 30 10:47:51 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:47:51 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:47:51 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:47:51 user nova-compute[75020]:     </memballoon>
Nov 30 10:47:51 user nova-compute[75020]:   </devices>
Nov 30 10:47:51 user nova-compute[75020]: </domain>
Nov 30 10:47:51 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2135448650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2135448650',id=1,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-vybt0vmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:43Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=d88214a8-f7f1-4735-8faf-611d70a77d9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:41:9c,bridge_name='br-int',has_traffic_filtering=True,id=f756ed97-6717-4f69-b7ea-3e503a0d7bf2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf756ed97-67') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG os_vif [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:41:9c,bridge_name='br-int',has_traffic_filtering=True,id=f756ed97-6717-4f69-b7ea-3e503a0d7bf2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf756ed97-67') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Created schema index Interface.name {{(pid=75020) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Created schema index Port.name {{(pid=75020) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Created schema index Bridge.name {{(pid=75020) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk 1073741824" returned: 0 in 0.140s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [POLLOUT] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58e893db-a5d4-5912-8a87-97fbb40892a0', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:51 user nova-compute[75020]: INFO oslo.privsep.daemon [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpgf80cpwd/privsep.sock']
Nov 30 10:47:51 user sudo[84363]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpgf80cpwd/privsep.sock
Nov 30 10:47:51 user sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:47:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Cannot resize image /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Ensure instance console log exists: /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Successfully updated port: a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "refresh_cache-134d8045-4c59-429d-9c01-6c451f0fa58b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquired lock "refresh_cache-134d8045-4c59-429d-9c01-6c451f0fa58b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-5ec4dc7e-a32e-4613-9de4-de5777baea81 req-916962f3-6266-4ad8-baae-5756f6da3ff3 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received event network-changed-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-5ec4dc7e-a32e-4613-9de4-de5777baea81 req-916962f3-6266-4ad8-baae-5756f6da3ff3 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Refreshing instance network info cache due to event network-changed-a4a4832e-d076-40a2-b8f0-c844402dd1de. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ec4dc7e-a32e-4613-9de4-de5777baea81 req-916962f3-6266-4ad8-baae-5756f6da3ff3 service nova] Acquiring lock "refresh_cache-134d8045-4c59-429d-9c01-6c451f0fa58b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Successfully updated port: d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquired lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-10f10310-0d54-42fc-a2ee-1703e36aecd7 req-7338675c-a5dc-4f10-ab96-07d2a42bb617 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-changed-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-10f10310-0d54-42fc-a2ee-1703e36aecd7 req-7338675c-a5dc-4f10-ab96-07d2a42bb617 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Refreshing instance network info cache due to event network-changed-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:47:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-10f10310-0d54-42fc-a2ee-1703e36aecd7 req-7338675c-a5dc-4f10-ab96-07d2a42bb617 service nova] Acquiring lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user sudo[84363]: pam_unix(sudo:session): session closed for user root
Nov 30 10:47:53 user nova-compute[75020]: INFO oslo.privsep.daemon [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Spawned new privsep daemon via rootwrap
Nov 30 10:47:53 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 10:47:53 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 10:47:53 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 30 10:47:53 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84373
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Successfully updated port: a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquired lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.neutron [req-595937ee-a53f-4636-aafb-26920a1f1a8d req-2a780ecf-e5fe-449d-8363-e6f9cfad1cae service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updated VIF entry in instance network info cache for port f756ed97-6717-4f69-b7ea-3e503a0d7bf2. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.neutron [req-595937ee-a53f-4636-aafb-26920a1f1a8d req-2a780ecf-e5fe-449d-8363-e6f9cfad1cae service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updating instance_info_cache with network_info: [{"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-595937ee-a53f-4636-aafb-26920a1f1a8d req-2a780ecf-e5fe-449d-8363-e6f9cfad1cae service nova] Releasing lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Updating instance_info_cache with network_info: [{"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Releasing lock "refresh_cache-134d8045-4c59-429d-9c01-6c451f0fa58b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Instance network_info: |[{"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ec4dc7e-a32e-4613-9de4-de5777baea81 req-916962f3-6266-4ad8-baae-5756f6da3ff3 service nova] Acquired lock "refresh_cache-134d8045-4c59-429d-9c01-6c451f0fa58b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.neutron [req-5ec4dc7e-a32e-4613-9de4-de5777baea81 req-916962f3-6266-4ad8-baae-5756f6da3ff3 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Refreshing network info cache for port a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Start _get_guest_xml network_info=[{"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:47:53 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:53 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-449197611',display_name='tempest-DeleteServersTestJSON-server-449197611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-449197611',id=3,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d45560c8a2642bd8c079763d52047e6',ramdisk_id='',reservation_id='r-i8e78a0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1785683651',owner_user_name='tempest-DeleteServersTestJSON-1785683651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:47Z,user_data=None,user_id='a0beedde307a4b06abb0dd9141d208e6',uuid=134d8045-4c59-429d-9c01-6c451f0fa58b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Converting VIF {"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:81:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4a4832e-d076-40a2-b8f0-c844402dd1de,network=Network(df2e9d30-a745-4863-8a91-97f1a454aae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a4832e-d0') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lazy-loading 'pci_devices' on Instance uuid 134d8045-4c59-429d-9c01-6c451f0fa58b {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf756ed97-67, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf756ed97-67, col_values=(('qos', UUID('f44c9688-56b3-4063-9250-6a1bc2b8a18b')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf756ed97-67, col_values=(('external_ids', {'iface-id': 'f756ed97-6717-4f69-b7ea-3e503a0d7bf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:41:9c', 'vm-uuid': 'd88214a8-f7f1-4735-8faf-611d70a77d9f'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:47:53 user nova-compute[75020]:   <uuid>134d8045-4c59-429d-9c01-6c451f0fa58b</uuid>
Nov 30 10:47:53 user nova-compute[75020]:   <name>instance-00000003</name>
Nov 30 10:47:53 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:47:53 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:47:53 user nova-compute[75020]:   <metadata>
Nov 30 10:47:53 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:47:53 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:47:53 user nova-compute[75020]:       <nova:name>tempest-DeleteServersTestJSON-server-449197611</nova:name>
Nov 30 10:47:53 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:47:53</nova:creationTime>
Nov 30 10:47:53 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:47:53 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:47:53 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:47:53 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:47:53 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:47:53 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:47:53 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:47:53 user nova-compute[75020]:       <nova:owner>
Nov 30 10:47:53 user nova-compute[75020]:         <nova:user uuid="a0beedde307a4b06abb0dd9141d208e6">tempest-DeleteServersTestJSON-1785683651-project-member</nova:user>
Nov 30 10:47:53 user nova-compute[75020]:         <nova:project uuid="1d45560c8a2642bd8c079763d52047e6">tempest-DeleteServersTestJSON-1785683651</nova:project>
Nov 30 10:47:53 user nova-compute[75020]:       </nova:owner>
Nov 30 10:47:53 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:47:53 user nova-compute[75020]:       <nova:ports>
Nov 30 10:47:53 user nova-compute[75020]:         <nova:port uuid="a4a4832e-d076-40a2-b8f0-c844402dd1de">
Nov 30 10:47:53 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 10:47:53 user nova-compute[75020]:         </nova:port>
Nov 30 10:47:53 user nova-compute[75020]:       </nova:ports>
Nov 30 10:47:53 user nova-compute[75020]:     </nova:instance>
Nov 30 10:47:53 user nova-compute[75020]:   </metadata>
Nov 30 10:47:53 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:47:53 user nova-compute[75020]:     <system>
Nov 30 10:47:53 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:47:53 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:47:53 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:47:53 user nova-compute[75020]:       <entry name="serial">134d8045-4c59-429d-9c01-6c451f0fa58b</entry>
Nov 30 10:47:53 user nova-compute[75020]:       <entry name="uuid">134d8045-4c59-429d-9c01-6c451f0fa58b</entry>
Nov 30 10:47:53 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:47:53 user nova-compute[75020]:     </system>
Nov 30 10:47:53 user nova-compute[75020]:   </sysinfo>
Nov 30 10:47:53 user nova-compute[75020]:   <os>
Nov 30 10:47:53 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:47:53 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:47:53 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:47:53 user nova-compute[75020]:   </os>
Nov 30 10:47:53 user nova-compute[75020]:   <features>
Nov 30 10:47:53 user nova-compute[75020]:     <acpi/>
Nov 30 10:47:53 user nova-compute[75020]:     <apic/>
Nov 30 10:47:53 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:47:53 user nova-compute[75020]:   </features>
Nov 30 10:47:53 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:47:53 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:47:53 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:47:53 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:47:53 user nova-compute[75020]:   </clock>
Nov 30 10:47:53 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:47:53 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:47:53 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:47:53 user nova-compute[75020]:   </cpu>
Nov 30 10:47:53 user nova-compute[75020]:   <devices>
Nov 30 10:47:53 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:47:53 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:47:53 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk"/>
Nov 30 10:47:53 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:47:53 user nova-compute[75020]:     </disk>
Nov 30 10:47:53 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:47:53 user nova-compute[75020]:       <mac address="fa:16:3e:fa:81:a5"/>
Nov 30 10:47:53 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:53 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:47:53 user nova-compute[75020]:       <target dev="tapa4a4832e-d0"/>
Nov 30 10:47:53 user nova-compute[75020]:     </interface>
Nov 30 10:47:53 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:47:53 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/console.log" append="off"/>
Nov 30 10:47:53 user nova-compute[75020]:     </serial>
Nov 30 10:47:53 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:47:53 user nova-compute[75020]:     <video>
Nov 30 10:47:53 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:53 user nova-compute[75020]:     </video>
Nov 30 10:47:53 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:47:53 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:47:53 user nova-compute[75020]:     </rng>
Nov 30 10:47:53 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:47:53 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:47:53 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:47:53 user nova-compute[75020]:     </memballoon>
Nov 30 10:47:53 user nova-compute[75020]:   </devices>
Nov 30 10:47:53 user nova-compute[75020]: </domain>
Nov 30 10:47:53 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-449197611',display_name='tempest-DeleteServersTestJSON-server-449197611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-449197611',id=3,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d45560c8a2642bd8c079763d52047e6',ramdisk_id='',reservation_id='r-i8e78a0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1785683651',owner_user_name='tempest-DeleteServersTestJSON-1785683651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:47Z,user_data=None,user_id='a0beedde307a4b06abb0dd9141d208e6',uuid=134d8045-4c59-429d-9c01-6c451f0fa58b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Converting VIF {"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:81:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4a4832e-d076-40a2-b8f0-c844402dd1de,network=Network(df2e9d30-a745-4863-8a91-97f1a454aae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a4832e-d0') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG os_vif [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:81:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4a4832e-d076-40a2-b8f0-c844402dd1de,network=Network(df2e9d30-a745-4863-8a91-97f1a454aae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a4832e-d0') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: INFO os_vif [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:41:9c,bridge_name='br-int',has_traffic_filtering=True,id=f756ed97-6717-4f69-b7ea-3e503a0d7bf2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf756ed97-67')
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dd29cb9-e091-5f6b-8a40-dafdd7323d8e', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4a4832e-d0, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4a4832e-d0, col_values=(('qos', UUID('745da233-ad83-4d8e-a21f-975ade9f42b6')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4a4832e-d0, col_values=(('external_ids', {'iface-id': 'a4a4832e-d076-40a2-b8f0-c844402dd1de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:81:a5', 'vm-uuid': '134d8045-4c59-429d-9c01-6c451f0fa58b'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:53 user nova-compute[75020]: INFO os_vif [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:81:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4a4832e-d076-40a2-b8f0-c844402dd1de,network=Network(df2e9d30-a745-4863-8a91-97f1a454aae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a4832e-d0')
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No VIF found with MAC fa:16:3e:87:41:9c, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] No VIF found with MAC fa:16:3e:fa:81:a5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-30bfcd13-89a2-4f4e-bd1b-3fc85a5c139f req-18b6a7d0-1184-47e9-97aa-b2e64c981537 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-changed-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-30bfcd13-89a2-4f4e-bd1b-3fc85a5c139f req-18b6a7d0-1184-47e9-97aa-b2e64c981537 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Refreshing instance network info cache due to event network-changed-a3626203-1d0f-4d96-bf21-796358c11fd2. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-30bfcd13-89a2-4f4e-bd1b-3fc85a5c139f req-18b6a7d0-1184-47e9-97aa-b2e64c981537 service nova] Acquiring lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating instance_info_cache with network_info: [{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Releasing lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance network_info: |[{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-10f10310-0d54-42fc-a2ee-1703e36aecd7 req-7338675c-a5dc-4f10-ab96-07d2a42bb617 service nova] Acquired lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-10f10310-0d54-42fc-a2ee-1703e36aecd7 req-7338675c-a5dc-4f10-ab96-07d2a42bb617 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Refreshing network info cache for port d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Start _get_guest_xml network_info=[{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:47:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'pci_devices' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:47:54 user nova-compute[75020]:   <uuid>829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</uuid>
Nov 30 10:47:54 user nova-compute[75020]:   <name>instance-00000002</name>
Nov 30 10:47:54 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:47:54 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:47:54 user nova-compute[75020]:   <metadata>
Nov 30 10:47:54 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:47:54 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:47:54 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeTestJSON-server-885363355</nova:name>
Nov 30 10:47:54 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:47:54</nova:creationTime>
Nov 30 10:47:54 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:47:54 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:47:54 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:47:54 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:47:54 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:47:54 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:47:54 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:47:54 user nova-compute[75020]:       <nova:owner>
Nov 30 10:47:54 user nova-compute[75020]:         <nova:user uuid="007e7cb60a1540c0a4168b27b2c92e0b">tempest-AttachVolumeTestJSON-1562861090-project-member</nova:user>
Nov 30 10:47:54 user nova-compute[75020]:         <nova:project uuid="c2765886644e4b5eb42a29eb8c0a82e1">tempest-AttachVolumeTestJSON-1562861090</nova:project>
Nov 30 10:47:54 user nova-compute[75020]:       </nova:owner>
Nov 30 10:47:54 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:47:54 user nova-compute[75020]:       <nova:ports>
Nov 30 10:47:54 user nova-compute[75020]:         <nova:port uuid="d3370635-c4d4-4dc7-8a3c-a3dd2756dff0">
Nov 30 10:47:54 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 10:47:54 user nova-compute[75020]:         </nova:port>
Nov 30 10:47:54 user nova-compute[75020]:       </nova:ports>
Nov 30 10:47:54 user nova-compute[75020]:     </nova:instance>
Nov 30 10:47:54 user nova-compute[75020]:   </metadata>
Nov 30 10:47:54 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:47:54 user nova-compute[75020]:     <system>
Nov 30 10:47:54 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:47:54 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:47:54 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:47:54 user nova-compute[75020]:       <entry name="serial">829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</entry>
Nov 30 10:47:54 user nova-compute[75020]:       <entry name="uuid">829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</entry>
Nov 30 10:47:54 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:47:54 user nova-compute[75020]:     </system>
Nov 30 10:47:54 user nova-compute[75020]:   </sysinfo>
Nov 30 10:47:54 user nova-compute[75020]:   <os>
Nov 30 10:47:54 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:47:54 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:47:54 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:47:54 user nova-compute[75020]:   </os>
Nov 30 10:47:54 user nova-compute[75020]:   <features>
Nov 30 10:47:54 user nova-compute[75020]:     <acpi/>
Nov 30 10:47:54 user nova-compute[75020]:     <apic/>
Nov 30 10:47:54 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:47:54 user nova-compute[75020]:   </features>
Nov 30 10:47:54 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:47:54 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:47:54 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:47:54 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:47:54 user nova-compute[75020]:   </clock>
Nov 30 10:47:54 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:47:54 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:47:54 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:47:54 user nova-compute[75020]:   </cpu>
Nov 30 10:47:54 user nova-compute[75020]:   <devices>
Nov 30 10:47:54 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:47:54 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:47:54 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk"/>
Nov 30 10:47:54 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:47:54 user nova-compute[75020]:     </disk>
Nov 30 10:47:54 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:47:54 user nova-compute[75020]:       <mac address="fa:16:3e:54:c0:d7"/>
Nov 30 10:47:54 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:54 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:47:54 user nova-compute[75020]:       <target dev="tapd3370635-c4"/>
Nov 30 10:47:54 user nova-compute[75020]:     </interface>
Nov 30 10:47:54 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:47:54 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/console.log" append="off"/>
Nov 30 10:47:54 user nova-compute[75020]:     </serial>
Nov 30 10:47:54 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:47:54 user nova-compute[75020]:     <video>
Nov 30 10:47:54 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:54 user nova-compute[75020]:     </video>
Nov 30 10:47:54 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:47:54 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:47:54 user nova-compute[75020]:     </rng>
Nov 30 10:47:54 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:47:54 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:47:54 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:47:54 user nova-compute[75020]:     </memballoon>
Nov 30 10:47:54 user nova-compute[75020]:   </devices>
Nov 30 10:47:54 user nova-compute[75020]: </domain>
Nov 30 10:47:54 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG os_vif [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1f96adc-4f30-551c-89e9-e72083986872', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3370635-c4, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3370635-c4, col_values=(('qos', UUID('adee627f-0bcc-4a71-8ce7-66ff0c40701e')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3370635-c4, col_values=(('external_ids', {'iface-id': 'd3370635-c4d4-4dc7-8a3c-a3dd2756dff0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:c0:d7', 'vm-uuid': '829d8ebf-f5d9-4c51-80d1-fb6c40b1a699'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:54 user nova-compute[75020]: INFO os_vif [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4')
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No VIF found with MAC fa:16:3e:54:c0:d7, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Successfully created port: 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-5ec4dc7e-a32e-4613-9de4-de5777baea81 req-916962f3-6266-4ad8-baae-5756f6da3ff3 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Updated VIF entry in instance network info cache for port a4a4832e-d076-40a2-b8f0-c844402dd1de. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-5ec4dc7e-a32e-4613-9de4-de5777baea81 req-916962f3-6266-4ad8-baae-5756f6da3ff3 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Updating instance_info_cache with network_info: [{"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ec4dc7e-a32e-4613-9de4-de5777baea81 req-916962f3-6266-4ad8-baae-5756f6da3ff3 service nova] Releasing lock "refresh_cache-134d8045-4c59-429d-9c01-6c451f0fa58b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updating instance_info_cache with network_info: [{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Releasing lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Instance network_info: |[{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-30bfcd13-89a2-4f4e-bd1b-3fc85a5c139f req-18b6a7d0-1184-47e9-97aa-b2e64c981537 service nova] Acquired lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.network.neutron [req-30bfcd13-89a2-4f4e-bd1b-3fc85a5c139f req-18b6a7d0-1184-47e9-97aa-b2e64c981537 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Refreshing network info cache for port a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Start _get_guest_xml network_info=[{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:47:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-75449479',display_name='tempest-ServerActionsTestOtherA-server-75449479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-75449479',id=4,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-egyu61be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=1c7e9069-f20d-4389-bbe9-5b3702d408e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=a3626203-1d0f-4d96-bf21-796358c11fd2,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3626203-1d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c7e9069-f20d-4389-bbe9-5b3702d408e5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:47:55 user nova-compute[75020]:   <uuid>1c7e9069-f20d-4389-bbe9-5b3702d408e5</uuid>
Nov 30 10:47:55 user nova-compute[75020]:   <name>instance-00000004</name>
Nov 30 10:47:55 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:47:55 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:47:55 user nova-compute[75020]:   <metadata>
Nov 30 10:47:55 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:47:55 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:47:55 user nova-compute[75020]:       <nova:name>tempest-ServerActionsTestOtherA-server-75449479</nova:name>
Nov 30 10:47:55 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:47:55</nova:creationTime>
Nov 30 10:47:55 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:47:55 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:47:55 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:47:55 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:47:55 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:47:55 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:47:55 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:47:55 user nova-compute[75020]:       <nova:owner>
Nov 30 10:47:55 user nova-compute[75020]:         <nova:user uuid="7f64ef255b2a48349a280bf3693af23f">tempest-ServerActionsTestOtherA-582760806-project-member</nova:user>
Nov 30 10:47:55 user nova-compute[75020]:         <nova:project uuid="e10919b523b740859f3ac98e31468a93">tempest-ServerActionsTestOtherA-582760806</nova:project>
Nov 30 10:47:55 user nova-compute[75020]:       </nova:owner>
Nov 30 10:47:55 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:47:55 user nova-compute[75020]:       <nova:ports>
Nov 30 10:47:55 user nova-compute[75020]:         <nova:port uuid="a3626203-1d0f-4d96-bf21-796358c11fd2">
Nov 30 10:47:55 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 10:47:55 user nova-compute[75020]:         </nova:port>
Nov 30 10:47:55 user nova-compute[75020]:       </nova:ports>
Nov 30 10:47:55 user nova-compute[75020]:     </nova:instance>
Nov 30 10:47:55 user nova-compute[75020]:   </metadata>
Nov 30 10:47:55 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:47:55 user nova-compute[75020]:     <system>
Nov 30 10:47:55 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:47:55 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:47:55 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:47:55 user nova-compute[75020]:       <entry name="serial">1c7e9069-f20d-4389-bbe9-5b3702d408e5</entry>
Nov 30 10:47:55 user nova-compute[75020]:       <entry name="uuid">1c7e9069-f20d-4389-bbe9-5b3702d408e5</entry>
Nov 30 10:47:55 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:47:55 user nova-compute[75020]:     </system>
Nov 30 10:47:55 user nova-compute[75020]:   </sysinfo>
Nov 30 10:47:55 user nova-compute[75020]:   <os>
Nov 30 10:47:55 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:47:55 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:47:55 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:47:55 user nova-compute[75020]:   </os>
Nov 30 10:47:55 user nova-compute[75020]:   <features>
Nov 30 10:47:55 user nova-compute[75020]:     <acpi/>
Nov 30 10:47:55 user nova-compute[75020]:     <apic/>
Nov 30 10:47:55 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:47:55 user nova-compute[75020]:   </features>
Nov 30 10:47:55 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:47:55 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:47:55 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:47:55 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:47:55 user nova-compute[75020]:   </clock>
Nov 30 10:47:55 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:47:55 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:47:55 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:47:55 user nova-compute[75020]:   </cpu>
Nov 30 10:47:55 user nova-compute[75020]:   <devices>
Nov 30 10:47:55 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:47:55 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:47:55 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk"/>
Nov 30 10:47:55 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:47:55 user nova-compute[75020]:     </disk>
Nov 30 10:47:55 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:47:55 user nova-compute[75020]:       <mac address="fa:16:3e:75:bf:67"/>
Nov 30 10:47:55 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:55 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:47:55 user nova-compute[75020]:       <target dev="tapa3626203-1d"/>
Nov 30 10:47:55 user nova-compute[75020]:     </interface>
Nov 30 10:47:55 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:47:55 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/console.log" append="off"/>
Nov 30 10:47:55 user nova-compute[75020]:     </serial>
Nov 30 10:47:55 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:47:55 user nova-compute[75020]:     <video>
Nov 30 10:47:55 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:55 user nova-compute[75020]:     </video>
Nov 30 10:47:55 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:47:55 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:47:55 user nova-compute[75020]:     </rng>
Nov 30 10:47:55 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:47:55 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:47:55 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:47:55 user nova-compute[75020]:     </memballoon>
Nov 30 10:47:55 user nova-compute[75020]:   </devices>
Nov 30 10:47:55 user nova-compute[75020]: </domain>
Nov 30 10:47:55 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-75449479',display_name='tempest-ServerActionsTestOtherA-server-75449479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-75449479',id=4,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-egyu61be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=1c7e9069-f20d-4389-bbe9-5b3702d408e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=a3626203-1d0f-4d96-bf21-796358c11fd2,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3626203-1d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG os_vif [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=a3626203-1d0f-4d96-bf21-796358c11fd2,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3626203-1d') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6f3cf33-75b5-5970-b62d-870b4a420fe8', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3626203-1d, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3626203-1d, col_values=(('qos', UUID('160cc0a1-66ca-4be4-8791-dc8e7b321334')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3626203-1d, col_values=(('external_ids', {'iface-id': 'a3626203-1d0f-4d96-bf21-796358c11fd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:bf:67', 'vm-uuid': '1c7e9069-f20d-4389-bbe9-5b3702d408e5'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:55 user nova-compute[75020]: INFO os_vif [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=a3626203-1d0f-4d96-bf21-796358c11fd2,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3626203-1d')
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No VIF found with MAC fa:16:3e:75:bf:67, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.network.neutron [req-10f10310-0d54-42fc-a2ee-1703e36aecd7 req-7338675c-a5dc-4f10-ab96-07d2a42bb617 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updated VIF entry in instance network info cache for port d3370635-c4d4-4dc7-8a3c-a3dd2756dff0. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG nova.network.neutron [req-10f10310-0d54-42fc-a2ee-1703e36aecd7 req-7338675c-a5dc-4f10-ab96-07d2a42bb617 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating instance_info_cache with network_info: [{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-10f10310-0d54-42fc-a2ee-1703e36aecd7 req-7338675c-a5dc-4f10-ab96-07d2a42bb617 service nova] Releasing lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:56 user nova-compute[75020]: DEBUG nova.network.neutron [req-30bfcd13-89a2-4f4e-bd1b-3fc85a5c139f req-18b6a7d0-1184-47e9-97aa-b2e64c981537 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updated VIF entry in instance network info cache for port a3626203-1d0f-4d96-bf21-796358c11fd2. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:47:56 user nova-compute[75020]: DEBUG nova.network.neutron [req-30bfcd13-89a2-4f4e-bd1b-3fc85a5c139f req-18b6a7d0-1184-47e9-97aa-b2e64c981537 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updating instance_info_cache with network_info: [{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-30bfcd13-89a2-4f4e-bd1b-3fc85a5c139f req-18b6a7d0-1184-47e9-97aa-b2e64c981537 service nova] Releasing lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG nova.network.neutron [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Successfully updated port: 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquired lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG nova.network.neutron [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdc68869-7d47-4091-bf67-68f9b0fa2bca req-c8b8f5ee-ca75-43a5-9f28-24985f2ded38 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-changed-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdc68869-7d47-4091-bf67-68f9b0fa2bca req-c8b8f5ee-ca75-43a5-9f28-24985f2ded38 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Refreshing instance network info cache due to event network-changed-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdc68869-7d47-4091-bf67-68f9b0fa2bca req-c8b8f5ee-ca75-43a5-9f28-24985f2ded38 service nova] Acquiring lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG nova.network.neutron [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.network.neutron [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating instance_info_cache with network_info: [{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Releasing lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance network_info: |[{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdc68869-7d47-4091-bf67-68f9b0fa2bca req-c8b8f5ee-ca75-43a5-9f28-24985f2ded38 service nova] Acquired lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.network.neutron [req-fdc68869-7d47-4091-bf67-68f9b0fa2bca req-c8b8f5ee-ca75-43a5-9f28-24985f2ded38 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Refreshing network info cache for port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Start _get_guest_xml network_info=[{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:47:58 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:58 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1075430230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1075430230',id=5,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9U8mBMZ0h7K8lJV9407mFRx1E9E6BfrnfMq1FhxGbl9GDd/B4bNbFXcIESnDYN3W4Elef2TabyP8ZrlhZA/5ujoP1+jBUf/HVCektXsUP2ThO2mH0G7f7uCCHkrsaeA==',key_name='tempest-keypair-1856789779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-kuebsqbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=a709433f-c094-4726-8498-c508e14f9d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'pci_devices' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:47:58 user nova-compute[75020]:   <uuid>a709433f-c094-4726-8498-c508e14f9d54</uuid>
Nov 30 10:47:58 user nova-compute[75020]:   <name>instance-00000005</name>
Nov 30 10:47:58 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:47:58 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:47:58 user nova-compute[75020]:   <metadata>
Nov 30 10:47:58 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:47:58 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:47:58 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1075430230</nova:name>
Nov 30 10:47:58 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:47:58</nova:creationTime>
Nov 30 10:47:58 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:47:58 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:47:58 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:47:58 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:47:58 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:47:58 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:47:58 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:47:58 user nova-compute[75020]:       <nova:owner>
Nov 30 10:47:58 user nova-compute[75020]:         <nova:user uuid="5d431a8177f54de08c3d0c03a3c9ff1e">tempest-AttachVolumeShelveTestJSON-1553674360-project-member</nova:user>
Nov 30 10:47:58 user nova-compute[75020]:         <nova:project uuid="0b0cce29854643d0b730dc664697dee7">tempest-AttachVolumeShelveTestJSON-1553674360</nova:project>
Nov 30 10:47:58 user nova-compute[75020]:       </nova:owner>
Nov 30 10:47:58 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:47:58 user nova-compute[75020]:       <nova:ports>
Nov 30 10:47:58 user nova-compute[75020]:         <nova:port uuid="4b71bc40-4d85-4dd0-8a0d-f215a4fc070f">
Nov 30 10:47:58 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 10:47:58 user nova-compute[75020]:         </nova:port>
Nov 30 10:47:58 user nova-compute[75020]:       </nova:ports>
Nov 30 10:47:58 user nova-compute[75020]:     </nova:instance>
Nov 30 10:47:58 user nova-compute[75020]:   </metadata>
Nov 30 10:47:58 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:47:58 user nova-compute[75020]:     <system>
Nov 30 10:47:58 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:47:58 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:47:58 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:47:58 user nova-compute[75020]:       <entry name="serial">a709433f-c094-4726-8498-c508e14f9d54</entry>
Nov 30 10:47:58 user nova-compute[75020]:       <entry name="uuid">a709433f-c094-4726-8498-c508e14f9d54</entry>
Nov 30 10:47:58 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:47:58 user nova-compute[75020]:     </system>
Nov 30 10:47:58 user nova-compute[75020]:   </sysinfo>
Nov 30 10:47:58 user nova-compute[75020]:   <os>
Nov 30 10:47:58 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:47:58 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:47:58 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:47:58 user nova-compute[75020]:   </os>
Nov 30 10:47:58 user nova-compute[75020]:   <features>
Nov 30 10:47:58 user nova-compute[75020]:     <acpi/>
Nov 30 10:47:58 user nova-compute[75020]:     <apic/>
Nov 30 10:47:58 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:47:58 user nova-compute[75020]:   </features>
Nov 30 10:47:58 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:47:58 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:47:58 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:47:58 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:47:58 user nova-compute[75020]:   </clock>
Nov 30 10:47:58 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:47:58 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:47:58 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:47:58 user nova-compute[75020]:   </cpu>
Nov 30 10:47:58 user nova-compute[75020]:   <devices>
Nov 30 10:47:58 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:47:58 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:47:58 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk"/>
Nov 30 10:47:58 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:47:58 user nova-compute[75020]:     </disk>
Nov 30 10:47:58 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:47:58 user nova-compute[75020]:       <mac address="fa:16:3e:c9:00:aa"/>
Nov 30 10:47:58 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:58 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:47:58 user nova-compute[75020]:       <target dev="tap4b71bc40-4d"/>
Nov 30 10:47:58 user nova-compute[75020]:     </interface>
Nov 30 10:47:58 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:47:58 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/console.log" append="off"/>
Nov 30 10:47:58 user nova-compute[75020]:     </serial>
Nov 30 10:47:58 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:47:58 user nova-compute[75020]:     <video>
Nov 30 10:47:58 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:47:58 user nova-compute[75020]:     </video>
Nov 30 10:47:58 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:47:58 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:47:58 user nova-compute[75020]:     </rng>
Nov 30 10:47:58 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:47:58 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:47:58 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:47:58 user nova-compute[75020]:     </memballoon>
Nov 30 10:47:58 user nova-compute[75020]:   </devices>
Nov 30 10:47:58 user nova-compute[75020]: </domain>
Nov 30 10:47:58 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1075430230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1075430230',id=5,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9U8mBMZ0h7K8lJV9407mFRx1E9E6BfrnfMq1FhxGbl9GDd/B4bNbFXcIESnDYN3W4Elef2TabyP8ZrlhZA/5ujoP1+jBUf/HVCektXsUP2ThO2mH0G7f7uCCHkrsaeA==',key_name='tempest-keypair-1856789779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-kuebsqbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:47:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=a709433f-c094-4726-8498-c508e14f9d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG os_vif [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79ef737b-349b-5646-8ca3-e24a1b62f14b', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b71bc40-4d, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b71bc40-4d, col_values=(('qos', UUID('9b67f981-32ac-40ed-ac42-59e148c6cf52')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b71bc40-4d, col_values=(('external_ids', {'iface-id': '4b71bc40-4d85-4dd0-8a0d-f215a4fc070f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:00:aa', 'vm-uuid': 'a709433f-c094-4726-8498-c508e14f9d54'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: INFO os_vif [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d')
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No VIF found with MAC fa:16:3e:c9:00:aa, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG nova.network.neutron [req-fdc68869-7d47-4091-bf67-68f9b0fa2bca req-c8b8f5ee-ca75-43a5-9f28-24985f2ded38 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updated VIF entry in instance network info cache for port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG nova.network.neutron [req-fdc68869-7d47-4091-bf67-68f9b0fa2bca req-c8b8f5ee-ca75-43a5-9f28-24985f2ded38 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating instance_info_cache with network_info: [{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdc68869-7d47-4091-bf67-68f9b0fa2bca req-c8b8f5ee-ca75-43a5-9f28-24985f2ded38 service nova] Releasing lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:47:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:02 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Instance spawned successfully.
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: INFO nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Took 19.91 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:03 user nova-compute[75020]: INFO nova.compute.manager [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Took 20.90 seconds to build instance.
Nov 30 10:48:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15466487-153c-4818-8c39-98fbf50c9ce1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.460s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Instance spawned successfully.
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Instance spawned successfully.
Nov 30 10:48:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance spawned successfully.
Nov 30 10:48:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:03 user nova-compute[75020]: INFO nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Took 14.31 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:03 user nova-compute[75020]: INFO nova.compute.manager [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Took 15.14 seconds to build instance.
Nov 30 10:48:04 user nova-compute[75020]: INFO nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Took 16.77 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b41a02b6-0b1b-4e3c-b746-9a2302eca243 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.288s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:04 user nova-compute[75020]: INFO nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Took 17.15 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:04 user nova-compute[75020]: INFO nova.compute.manager [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Took 17.95 seconds to build instance.
Nov 30 10:48:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e86e2c87-e120-4b38-9cf1-d37bd0809e96 tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.169s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:04 user nova-compute[75020]: INFO nova.compute.manager [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Took 18.23 seconds to build instance.
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:48:04 user nova-compute[75020]: INFO nova.compute.claims [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Claim successful on node user
Nov 30 10:48:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f811b25d-ad5a-4911-97b6-7570a3738480 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.605s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:04 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance spawned successfully.
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:04 user nova-compute[75020]: INFO nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Took 13.60 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:48:05 user nova-compute[75020]: INFO nova.compute.manager [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Took 14.76 seconds to build instance.
Nov 30 10:48:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6aa3a441-bea1-4706-bde9-b3b9ea0ef8c1 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.068s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.121s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:48:05 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:48:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:48:06 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Creating image(s)
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "/opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "/opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "/opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG nova.policy [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0bf43699eca49558d5605f7912dc32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348ee1a2d9e34ce8ad69a57323cbfb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.286s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.427s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk 1073741824" returned: 0 in 0.118s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.553s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.271s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Cannot resize image /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Ensure instance console log exists: /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG nova.compute.manager [req-3f356a27-c28f-4a46-acf4-b858366aec7a req-837e7852-24e0-4c2e-a369-d209842b7ca3 service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received event network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3f356a27-c28f-4a46-acf4-b858366aec7a req-837e7852-24e0-4c2e-a369-d209842b7ca3 service nova] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3f356a27-c28f-4a46-acf4-b858366aec7a req-837e7852-24e0-4c2e-a369-d209842b7ca3 service nova] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3f356a27-c28f-4a46-acf4-b858366aec7a req-837e7852-24e0-4c2e-a369-d209842b7ca3 service nova] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG nova.compute.manager [req-3f356a27-c28f-4a46-acf4-b858366aec7a req-837e7852-24e0-4c2e-a369-d209842b7ca3 service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] No waiting events found dispatching network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:08 user nova-compute[75020]: WARNING nova.compute.manager [req-3f356a27-c28f-4a46-acf4-b858366aec7a req-837e7852-24e0-4c2e-a369-d209842b7ca3 service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received unexpected event network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 for instance with vm_state active and task_state None.
Nov 30 10:48:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Successfully created port: 159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:48:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Successfully updated port: 159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquired lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-f608c308-1ddc-4179-8b1d-22d5a9ad2a85 req-dd86e067-7003-4c9e-a0dd-11aef1cab00c service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received event network-changed-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-f608c308-1ddc-4179-8b1d-22d5a9ad2a85 req-dd86e067-7003-4c9e-a0dd-11aef1cab00c service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Refreshing instance network info cache due to event network-changed-159fa17a-1663-4e44-bd28-074acd3bf84f. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f608c308-1ddc-4179-8b1d-22d5a9ad2a85 req-dd86e067-7003-4c9e-a0dd-11aef1cab00c service nova] Acquiring lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:48:10 user nova-compute[75020]: INFO nova.compute.claims [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Claim successful on node user
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received event network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] No waiting events found dispatching network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:10 user nova-compute[75020]: WARNING nova.compute.manager [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received unexpected event network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 for instance with vm_state active and task_state None.
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:10 user nova-compute[75020]: WARNING nova.compute.manager [req-49befcb3-7533-49f6-b43e-32c58e2489ca req-affbe349-4177-4f0b-b78e-004e05a9321b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state active and task_state None.
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updating instance_info_cache with network_info: [{"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Releasing lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Instance network_info: |[{"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f608c308-1ddc-4179-8b1d-22d5a9ad2a85 req-dd86e067-7003-4c9e-a0dd-11aef1cab00c service nova] Acquired lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-f608c308-1ddc-4179-8b1d-22d5a9ad2a85 req-dd86e067-7003-4c9e-a0dd-11aef1cab00c service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Refreshing network info cache for port 159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Start _get_guest_xml network_info=[{"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:48:11 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:11 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2035745060',display_name='tempest-VolumesAdminNegativeTest-server-2035745060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2035745060',id=6,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWDAC4ncLDW+VJj6qJ+/+yLF4ob4PIWUmLQ6lqHg2v5mEJZZVKo1OSs+BQsnwBOe/BlqXYp8dk33G+s9XX+CZ1GxHTsY3yIXcLC+X68aEzBCZKZENUD8aVldgSYmV9U1Q==',key_name='tempest-keypair-1944336700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348ee1a2d9e34ce8ad69a57323cbfb45',ramdisk_id='',reservation_id='r-s3mui5tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1613879927',owner_user_name='tempest-VolumesAdminNegativeTest-1613879927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0bf43699eca49558d5605f7912dc32a',uuid=88815763-252f-4506-aa0c-5524e8b96e08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converting VIF {"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c9:3a,bridge_name='br-int',has_traffic_filtering=True,id=159fa17a-1663-4e44-bd28-074acd3bf84f,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159fa17a-16') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lazy-loading 'pci_devices' on Instance uuid 88815763-252f-4506-aa0c-5524e8b96e08 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:48:11 user nova-compute[75020]:   <uuid>88815763-252f-4506-aa0c-5524e8b96e08</uuid>
Nov 30 10:48:11 user nova-compute[75020]:   <name>instance-00000006</name>
Nov 30 10:48:11 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:48:11 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:48:11 user nova-compute[75020]:   <metadata>
Nov 30 10:48:11 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:48:11 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:48:11 user nova-compute[75020]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2035745060</nova:name>
Nov 30 10:48:11 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:48:11</nova:creationTime>
Nov 30 10:48:11 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:48:11 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:48:11 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:48:11 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:48:11 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:48:11 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:48:11 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:48:11 user nova-compute[75020]:       <nova:owner>
Nov 30 10:48:11 user nova-compute[75020]:         <nova:user uuid="d0bf43699eca49558d5605f7912dc32a">tempest-VolumesAdminNegativeTest-1613879927-project-member</nova:user>
Nov 30 10:48:11 user nova-compute[75020]:         <nova:project uuid="348ee1a2d9e34ce8ad69a57323cbfb45">tempest-VolumesAdminNegativeTest-1613879927</nova:project>
Nov 30 10:48:11 user nova-compute[75020]:       </nova:owner>
Nov 30 10:48:11 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:48:11 user nova-compute[75020]:       <nova:ports>
Nov 30 10:48:11 user nova-compute[75020]:         <nova:port uuid="159fa17a-1663-4e44-bd28-074acd3bf84f">
Nov 30 10:48:11 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 10:48:11 user nova-compute[75020]:         </nova:port>
Nov 30 10:48:11 user nova-compute[75020]:       </nova:ports>
Nov 30 10:48:11 user nova-compute[75020]:     </nova:instance>
Nov 30 10:48:11 user nova-compute[75020]:   </metadata>
Nov 30 10:48:11 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:48:11 user nova-compute[75020]:     <system>
Nov 30 10:48:11 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:48:11 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:48:11 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:48:11 user nova-compute[75020]:       <entry name="serial">88815763-252f-4506-aa0c-5524e8b96e08</entry>
Nov 30 10:48:11 user nova-compute[75020]:       <entry name="uuid">88815763-252f-4506-aa0c-5524e8b96e08</entry>
Nov 30 10:48:11 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:48:11 user nova-compute[75020]:     </system>
Nov 30 10:48:11 user nova-compute[75020]:   </sysinfo>
Nov 30 10:48:11 user nova-compute[75020]:   <os>
Nov 30 10:48:11 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:48:11 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:48:11 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:48:11 user nova-compute[75020]:   </os>
Nov 30 10:48:11 user nova-compute[75020]:   <features>
Nov 30 10:48:11 user nova-compute[75020]:     <acpi/>
Nov 30 10:48:11 user nova-compute[75020]:     <apic/>
Nov 30 10:48:11 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:48:11 user nova-compute[75020]:   </features>
Nov 30 10:48:11 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:48:11 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:48:11 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:48:11 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:48:11 user nova-compute[75020]:   </clock>
Nov 30 10:48:11 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:48:11 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:48:11 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:48:11 user nova-compute[75020]:   </cpu>
Nov 30 10:48:11 user nova-compute[75020]:   <devices>
Nov 30 10:48:11 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:48:11 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:48:11 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk"/>
Nov 30 10:48:11 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:48:11 user nova-compute[75020]:     </disk>
Nov 30 10:48:11 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:48:11 user nova-compute[75020]:       <mac address="fa:16:3e:fc:c9:3a"/>
Nov 30 10:48:11 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:11 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:48:11 user nova-compute[75020]:       <target dev="tap159fa17a-16"/>
Nov 30 10:48:11 user nova-compute[75020]:     </interface>
Nov 30 10:48:11 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:48:11 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/console.log" append="off"/>
Nov 30 10:48:11 user nova-compute[75020]:     </serial>
Nov 30 10:48:11 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:48:11 user nova-compute[75020]:     <video>
Nov 30 10:48:11 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:11 user nova-compute[75020]:     </video>
Nov 30 10:48:11 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:48:11 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:48:11 user nova-compute[75020]:     </rng>
Nov 30 10:48:11 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:48:11 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:48:11 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:48:11 user nova-compute[75020]:     </memballoon>
Nov 30 10:48:11 user nova-compute[75020]:   </devices>
Nov 30 10:48:11 user nova-compute[75020]: </domain>
Nov 30 10:48:11 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2035745060',display_name='tempest-VolumesAdminNegativeTest-server-2035745060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2035745060',id=6,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWDAC4ncLDW+VJj6qJ+/+yLF4ob4PIWUmLQ6lqHg2v5mEJZZVKo1OSs+BQsnwBOe/BlqXYp8dk33G+s9XX+CZ1GxHTsY3yIXcLC+X68aEzBCZKZENUD8aVldgSYmV9U1Q==',key_name='tempest-keypair-1944336700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348ee1a2d9e34ce8ad69a57323cbfb45',ramdisk_id='',reservation_id='r-s3mui5tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1613879927',owner_user_name='tempest-VolumesAdminNegativeTest-1613879927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0bf43699eca49558d5605f7912dc32a',uuid=88815763-252f-4506-aa0c-5524e8b96e08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converting VIF {"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c9:3a,bridge_name='br-int',has_traffic_filtering=True,id=159fa17a-1663-4e44-bd28-074acd3bf84f,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159fa17a-16') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG os_vif [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c9:3a,bridge_name='br-int',has_traffic_filtering=True,id=159fa17a-1663-4e44-bd28-074acd3bf84f,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159fa17a-16') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b085b414-f1f6-596f-ae69-4da4837c6607', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap159fa17a-16, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap159fa17a-16, col_values=(('qos', UUID('64920d3b-01f9-4354-ba22-e44ff39df614')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap159fa17a-16, col_values=(('external_ids', {'iface-id': '159fa17a-1663-4e44-bd28-074acd3bf84f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:c9:3a', 'vm-uuid': '88815763-252f-4506-aa0c-5524e8b96e08'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:11 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:11 user nova-compute[75020]: INFO os_vif [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c9:3a,bridge_name='br-int',has_traffic_filtering=True,id=159fa17a-1663-4e44-bd28-074acd3bf84f,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159fa17a-16')
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] No VIF found with MAC fa:16:3e:fc:c9:3a, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:48:11 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Creating image(s)
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "/opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "/opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "/opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.policy [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b792f0a481254cbab52e602e26979a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231588d67fc5495c90dd06049fa048e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-f608c308-1ddc-4179-8b1d-22d5a9ad2a85 req-dd86e067-7003-4c9e-a0dd-11aef1cab00c service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updated VIF entry in instance network info cache for port 159fa17a-1663-4e44-bd28-074acd3bf84f. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-f608c308-1ddc-4179-8b1d-22d5a9ad2a85 req-dd86e067-7003-4c9e-a0dd-11aef1cab00c service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updating instance_info_cache with network_info: [{"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f608c308-1ddc-4179-8b1d-22d5a9ad2a85 req-dd86e067-7003-4c9e-a0dd-11aef1cab00c service nova] Releasing lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.343s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.009s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.424s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk 1073741824" returned: 0 in 0.089s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.527s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-d60a87a4-8de1-488f-add5-21d3ca156096 req-e7135349-bc66-44c6-8a0f-483b5802f26b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d60a87a4-8de1-488f-add5-21d3ca156096 req-e7135349-bc66-44c6-8a0f-483b5802f26b service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d60a87a4-8de1-488f-add5-21d3ca156096 req-e7135349-bc66-44c6-8a0f-483b5802f26b service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d60a87a4-8de1-488f-add5-21d3ca156096 req-e7135349-bc66-44c6-8a0f-483b5802f26b service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-d60a87a4-8de1-488f-add5-21d3ca156096 req-e7135349-bc66-44c6-8a0f-483b5802f26b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:12 user nova-compute[75020]: WARNING nova.compute.manager [req-d60a87a4-8de1-488f-add5-21d3ca156096 req-e7135349-bc66-44c6-8a0f-483b5802f26b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state active and task_state None.
Nov 30 10:48:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.458s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:48:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Cannot resize image /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Ensure instance console log exists: /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:48:13 user nova-compute[75020]: INFO nova.compute.claims [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Claim successful on node user
Nov 30 10:48:14 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Successfully created port: a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-ca89898d-ee9a-4361-98f3-31c0f884fad0 req-2f5acb2a-6602-459d-a8eb-d265b3a0d835 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ca89898d-ee9a-4361-98f3-31c0f884fad0 req-2f5acb2a-6602-459d-a8eb-d265b3a0d835 service nova] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ca89898d-ee9a-4361-98f3-31c0f884fad0 req-2f5acb2a-6602-459d-a8eb-d265b3a0d835 service nova] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ca89898d-ee9a-4361-98f3-31c0f884fad0 req-2f5acb2a-6602-459d-a8eb-d265b3a0d835 service nova] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-ca89898d-ee9a-4361-98f3-31c0f884fad0 req-2f5acb2a-6602-459d-a8eb-d265b3a0d835 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] No waiting events found dispatching network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:14 user nova-compute[75020]: WARNING nova.compute.manager [req-ca89898d-ee9a-4361-98f3-31c0f884fad0 req-2f5acb2a-6602-459d-a8eb-d265b3a0d835 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received unexpected event network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 for instance with vm_state active and task_state None.
Nov 30 10:48:14 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.860s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:48:14 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:48:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 30 10:48:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG nova.policy [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f3745f257ba49c4b4de2e51d2d8ec22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd909ba3afb5482ab3d20c7d56c7c4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:48:15 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Creating image(s)
Nov 30 10:48:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "/opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "/opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "/opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "385cab2323ef191b8e030592a61ce2df60c0a2cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "385cab2323ef191b8e030592a61ce2df60c0a2cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Successfully updated port: a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquired lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:15 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-285fcaa1-6a2d-461b-9ddd-591325d364e1 req-1f9bbaec-7f2f-4876-9f55-0d80533096aa service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received event network-changed-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-285fcaa1-6a2d-461b-9ddd-591325d364e1 req-1f9bbaec-7f2f-4876-9f55-0d80533096aa service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Refreshing instance network info cache due to event network-changed-a07ca90e-cde9-4f99-891b-3f1a28e95650. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-285fcaa1-6a2d-461b-9ddd-591325d364e1 req-1f9bbaec-7f2f-4876-9f55-0d80533096aa service nova] Acquiring lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Instance spawned successfully.
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf.part --force-share --output=json" returned: 0 in 0.295s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.images [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] 309f6f84-3967-469f-8f2f-95f9d4deed67 was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf.part /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:16 user nova-compute[75020]: INFO nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Took 10.59 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf.part /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf.converted" returned: 0 in 0.316s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updating instance_info_cache with network_info: [{"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:16 user nova-compute[75020]: INFO nova.compute.manager [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Took 12.64 seconds to build instance.
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Releasing lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Instance network_info: |[{"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-285fcaa1-6a2d-461b-9ddd-591325d364e1 req-1f9bbaec-7f2f-4876-9f55-0d80533096aa service nova] Acquired lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.network.neutron [req-285fcaa1-6a2d-461b-9ddd-591325d364e1 req-1f9bbaec-7f2f-4876-9f55-0d80533096aa service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Refreshing network info cache for port a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Start _get_guest_xml network_info=[{"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b69ff899-d3e0-4e31-ba4b-f4b705ac03a1 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.037s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] No waiting events found dispatching network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:16 user nova-compute[75020]: WARNING nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received unexpected event network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 for instance with vm_state active and task_state None.
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received event network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] No waiting events found dispatching network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:16 user nova-compute[75020]: WARNING nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received unexpected event network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de for instance with vm_state active and task_state None.
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received event network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] No waiting events found dispatching network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:16 user nova-compute[75020]: WARNING nova.compute.manager [req-badf6cfb-aaa4-48f4-a040-61e2cc56f7f8 req-10624d4b-f099-4632-b4a2-30e52a810a1b service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received unexpected event network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de for instance with vm_state active and task_state None.
Nov 30 10:48:16 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:16 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:48:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1069569943',display_name='tempest-TestVolumeSwap-server-1069569943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1069569943',id=7,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA6RgdEXXeMAVF3XJ0bm8ecQPC2qJKO8emzyVQa7Lz4LYeEz5IqZaXu9gXg/ENEh1v2h/W2K4EhFbb8CA9vsWchUE5d9jzxaaNjuFchSoAgRTfX6HzeVcg/1IN4IPpG6w==',key_name='tempest-keypair-1650235237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='231588d67fc5495c90dd06049fa048e3',ramdisk_id='',reservation_id='r-br143mv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-770012424',owner_user_name='tempest-TestVolumeSwap-770012424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b792f0a481254cbab52e602e26979a4a',uuid=77a73463-ea12-43c3-83a4-803f4a535010,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Converting VIF {"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:43:61,bridge_name='br-int',has_traffic_filtering=True,id=a07ca90e-cde9-4f99-891b-3f1a28e95650,network=Network(53cfc59e-d2c7-432e-9239-d0f66e201132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ca90e-cd') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lazy-loading 'pci_devices' on Instance uuid 77a73463-ea12-43c3-83a4-803f4a535010 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:48:17 user nova-compute[75020]:   <uuid>77a73463-ea12-43c3-83a4-803f4a535010</uuid>
Nov 30 10:48:17 user nova-compute[75020]:   <name>instance-00000007</name>
Nov 30 10:48:17 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:48:17 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:48:17 user nova-compute[75020]:   <metadata>
Nov 30 10:48:17 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:48:17 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:48:17 user nova-compute[75020]:       <nova:name>tempest-TestVolumeSwap-server-1069569943</nova:name>
Nov 30 10:48:17 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:48:16</nova:creationTime>
Nov 30 10:48:17 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:48:17 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:48:17 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:48:17 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:48:17 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:48:17 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:48:17 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:48:17 user nova-compute[75020]:       <nova:owner>
Nov 30 10:48:17 user nova-compute[75020]:         <nova:user uuid="b792f0a481254cbab52e602e26979a4a">tempest-TestVolumeSwap-770012424-project-member</nova:user>
Nov 30 10:48:17 user nova-compute[75020]:         <nova:project uuid="231588d67fc5495c90dd06049fa048e3">tempest-TestVolumeSwap-770012424</nova:project>
Nov 30 10:48:17 user nova-compute[75020]:       </nova:owner>
Nov 30 10:48:17 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:48:17 user nova-compute[75020]:       <nova:ports>
Nov 30 10:48:17 user nova-compute[75020]:         <nova:port uuid="a07ca90e-cde9-4f99-891b-3f1a28e95650">
Nov 30 10:48:17 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 10:48:17 user nova-compute[75020]:         </nova:port>
Nov 30 10:48:17 user nova-compute[75020]:       </nova:ports>
Nov 30 10:48:17 user nova-compute[75020]:     </nova:instance>
Nov 30 10:48:17 user nova-compute[75020]:   </metadata>
Nov 30 10:48:17 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:48:17 user nova-compute[75020]:     <system>
Nov 30 10:48:17 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:48:17 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:48:17 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:48:17 user nova-compute[75020]:       <entry name="serial">77a73463-ea12-43c3-83a4-803f4a535010</entry>
Nov 30 10:48:17 user nova-compute[75020]:       <entry name="uuid">77a73463-ea12-43c3-83a4-803f4a535010</entry>
Nov 30 10:48:17 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:48:17 user nova-compute[75020]:     </system>
Nov 30 10:48:17 user nova-compute[75020]:   </sysinfo>
Nov 30 10:48:17 user nova-compute[75020]:   <os>
Nov 30 10:48:17 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:48:17 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:48:17 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:48:17 user nova-compute[75020]:   </os>
Nov 30 10:48:17 user nova-compute[75020]:   <features>
Nov 30 10:48:17 user nova-compute[75020]:     <acpi/>
Nov 30 10:48:17 user nova-compute[75020]:     <apic/>
Nov 30 10:48:17 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:48:17 user nova-compute[75020]:   </features>
Nov 30 10:48:17 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:48:17 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:48:17 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:48:17 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:48:17 user nova-compute[75020]:   </clock>
Nov 30 10:48:17 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:48:17 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:48:17 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:48:17 user nova-compute[75020]:   </cpu>
Nov 30 10:48:17 user nova-compute[75020]:   <devices>
Nov 30 10:48:17 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:48:17 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:48:17 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk"/>
Nov 30 10:48:17 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:48:17 user nova-compute[75020]:     </disk>
Nov 30 10:48:17 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:48:17 user nova-compute[75020]:       <mac address="fa:16:3e:b8:43:61"/>
Nov 30 10:48:17 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:17 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:48:17 user nova-compute[75020]:       <target dev="tapa07ca90e-cd"/>
Nov 30 10:48:17 user nova-compute[75020]:     </interface>
Nov 30 10:48:17 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:48:17 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/console.log" append="off"/>
Nov 30 10:48:17 user nova-compute[75020]:     </serial>
Nov 30 10:48:17 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:48:17 user nova-compute[75020]:     <video>
Nov 30 10:48:17 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:17 user nova-compute[75020]:     </video>
Nov 30 10:48:17 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:48:17 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:48:17 user nova-compute[75020]:     </rng>
Nov 30 10:48:17 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:48:17 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:48:17 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:48:17 user nova-compute[75020]:     </memballoon>
Nov 30 10:48:17 user nova-compute[75020]:   </devices>
Nov 30 10:48:17 user nova-compute[75020]: </domain>
Nov 30 10:48:17 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1069569943',display_name='tempest-TestVolumeSwap-server-1069569943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1069569943',id=7,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA6RgdEXXeMAVF3XJ0bm8ecQPC2qJKO8emzyVQa7Lz4LYeEz5IqZaXu9gXg/ENEh1v2h/W2K4EhFbb8CA9vsWchUE5d9jzxaaNjuFchSoAgRTfX6HzeVcg/1IN4IPpG6w==',key_name='tempest-keypair-1650235237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='231588d67fc5495c90dd06049fa048e3',ramdisk_id='',reservation_id='r-br143mv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-770012424',owner_user_name='tempest-TestVolumeSwap-770012424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b792f0a481254cbab52e602e26979a4a',uuid=77a73463-ea12-43c3-83a4-803f4a535010,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Converting VIF {"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:43:61,bridge_name='br-int',has_traffic_filtering=True,id=a07ca90e-cde9-4f99-891b-3f1a28e95650,network=Network(53cfc59e-d2c7-432e-9239-d0f66e201132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ca90e-cd') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG os_vif [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:43:61,bridge_name='br-int',has_traffic_filtering=True,id=a07ca90e-cde9-4f99-891b-3f1a28e95650,network=Network(53cfc59e-d2c7-432e-9239-d0f66e201132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ca90e-cd') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78fe7001-c718-52df-9c8b-15192525a869', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf.converted --force-share --output=json" returned: 0 in 0.307s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "385cab2323ef191b8e030592a61ce2df60c0a2cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.767s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa07ca90e-cd, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa07ca90e-cd, col_values=(('qos', UUID('f9076617-fd46-4c22-83e2-1481e53c0ec5')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa07ca90e-cd, col_values=(('external_ids', {'iface-id': 'a07ca90e-cde9-4f99-891b-3f1a28e95650', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:43:61', 'vm-uuid': '77a73463-ea12-43c3-83a4-803f4a535010'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:17 user nova-compute[75020]: INFO os_vif [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:43:61,bridge_name='br-int',has_traffic_filtering=True,id=a07ca90e-cde9-4f99-891b-3f1a28e95650,network=Network(53cfc59e-d2c7-432e-9239-d0f66e201132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ca90e-cd')
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] No VIF found with MAC fa:16:3e:b8:43:61, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf --force-share --output=json" returned: 0 in 0.294s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "385cab2323ef191b8e030592a61ce2df60c0a2cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "385cab2323ef191b8e030592a61ce2df60c0a2cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf --force-share --output=json" returned: 0 in 0.305s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf,backing_fmt=raw /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-285fcaa1-6a2d-461b-9ddd-591325d364e1 req-1f9bbaec-7f2f-4876-9f55-0d80533096aa service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updated VIF entry in instance network info cache for port a07ca90e-cde9-4f99-891b-3f1a28e95650. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-285fcaa1-6a2d-461b-9ddd-591325d364e1 req-1f9bbaec-7f2f-4876-9f55-0d80533096aa service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updating instance_info_cache with network_info: [{"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf,backing_fmt=raw /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk 1073741824" returned: 0 in 0.138s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "385cab2323ef191b8e030592a61ce2df60c0a2cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.447s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-285fcaa1-6a2d-461b-9ddd-591325d364e1 req-1f9bbaec-7f2f-4876-9f55-0d80533096aa service nova] Releasing lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-cb725e8d-01e3-4c3b-a1ca-e3d163a9c68d req-f0879ffc-f975-478d-83e3-148a465a96b3 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received event network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb725e8d-01e3-4c3b-a1ca-e3d163a9c68d req-f0879ffc-f975-478d-83e3-148a465a96b3 service nova] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb725e8d-01e3-4c3b-a1ca-e3d163a9c68d req-f0879ffc-f975-478d-83e3-148a465a96b3 service nova] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb725e8d-01e3-4c3b-a1ca-e3d163a9c68d req-f0879ffc-f975-478d-83e3-148a465a96b3 service nova] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-cb725e8d-01e3-4c3b-a1ca-e3d163a9c68d req-f0879ffc-f975-478d-83e3-148a465a96b3 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] No waiting events found dispatching network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:18 user nova-compute[75020]: WARNING nova.compute.manager [req-cb725e8d-01e3-4c3b-a1ca-e3d163a9c68d req-f0879ffc-f975-478d-83e3-148a465a96b3 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received unexpected event network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f for instance with vm_state active and task_state None.
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:48:18 user nova-compute[75020]: INFO nova.compute.claims [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Claim successful on node user
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf --force-share --output=json" returned: 0 in 0.252s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Cannot resize image /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Ensure instance console log exists: /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Successfully created port: 4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.707s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:48:18 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.policy [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4aa8049f42b46e5b5b8f894c56927be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941912a981d343bfa3e50a94195ec953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:48:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:48:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Creating image(s)
Nov 30 10:48:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.523s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Successfully updated port: 4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-7d91d07e-4504-4929-9828-7f65c5d75d26 req-91b07e0f-fb3a-4c9d-82b2-c95017e1f0db service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received event network-changed-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-7d91d07e-4504-4929-9828-7f65c5d75d26 req-91b07e0f-fb3a-4c9d-82b2-c95017e1f0db service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Refreshing instance network info cache due to event network-changed-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7d91d07e-4504-4929-9828-7f65c5d75d26 req-91b07e0f-fb3a-4c9d-82b2-c95017e1f0db service nova] Acquiring lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7d91d07e-4504-4929-9828-7f65c5d75d26 req-91b07e0f-fb3a-4c9d-82b2-c95017e1f0db service nova] Acquired lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-7d91d07e-4504-4929-9828-7f65c5d75d26 req-91b07e0f-fb3a-4c9d-82b2-c95017e1f0db service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Refreshing network info cache for port 4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received event network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] No waiting events found dispatching network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:20 user nova-compute[75020]: WARNING nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received unexpected event network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f for instance with vm_state active and task_state None.
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received event network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] No waiting events found dispatching network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:20 user nova-compute[75020]: WARNING nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received unexpected event network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 for instance with vm_state building and task_state spawning.
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received event network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] No waiting events found dispatching network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:20 user nova-compute[75020]: WARNING nova.compute.manager [req-e8e8be85-8714-400c-aad7-8de14cb4d81f req-88621b73-821b-463a-988a-d412cfe52732 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received unexpected event network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 for instance with vm_state building and task_state spawning.
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.513s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-7d91d07e-4504-4929-9828-7f65c5d75d26 req-91b07e0f-fb3a-4c9d-82b2-c95017e1f0db service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk 1073741824" returned: 0 in 0.147s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.672s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.network.neutron [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Successfully created port: e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.308s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:48:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.network.neutron [req-7d91d07e-4504-4929-9828-7f65c5d75d26 req-91b07e0f-fb3a-4c9d-82b2-c95017e1f0db service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Cannot resize image /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Ensure instance console log exists: /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7d91d07e-4504-4929-9828-7f65c5d75d26 req-91b07e0f-fb3a-4c9d-82b2-c95017e1f0db service nova] Releasing lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquired lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Updating instance_info_cache with network_info: [{"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Successfully updated port: e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Releasing lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Instance network_info: |[{"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:48:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Start _get_guest_xml network_info=[{"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:48:01Z,direct_url=<?>,disk_format='qcow2',id=309f6f84-3967-469f-8f2f-95f9d4deed67,min_disk=0,min_ram=0,name='',owner='e8d3c8565ce549ac98ebf926f37ecc4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:48:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_options': None, 'size': 0, 'image_id': '309f6f84-3967-469f-8f2f-95f9d4deed67'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquired lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:48:22 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:22 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-4e4e9015-ee1c-4cf0-b363-34255c38efaf req-c812ccef-a6fd-42a2-9834-ce915646bdeb service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-changed-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-4e4e9015-ee1c-4cf0-b363-34255c38efaf req-c812ccef-a6fd-42a2-9834-ce915646bdeb service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Refreshing instance network info cache due to event network-changed-e6718122-9240-4368-987f-7557ca0ed04a. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4e4e9015-ee1c-4cf0-b363-34255c38efaf req-c812ccef-a6fd-42a2-9834-ce915646bdeb service nova] Acquiring lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:48:01Z,direct_url=<?>,disk_format='qcow2',id=309f6f84-3967-469f-8f2f-95f9d4deed67,min_disk=0,min_ram=0,name='',owner='e8d3c8565ce549ac98ebf926f37ecc4f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:48:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1430822462',display_name='tempest-AttachSCSIVolumeTestJSON-server-1430822462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1430822462',id=8,image_ref='309f6f84-3967-469f-8f2f-95f9d4deed67',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUPjzBzXOz/It6HliXZQj/rzwF2kTEuocy5ZSlrKoe8g+I+k/V3scQBxR3SMkBIIDTfqJMVCcrJOeKPh8ihPL7JalwO4CsaYn4hdZ0yNLx+nKrpmb74zvy2VuyShU280A==',key_name='tempest-keypair-272548173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd909ba3afb5482ab3d20c7d56c7c4a0',ramdisk_id='',reservation_id='r-ljae1e01',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='309f6f84-3967-469f-8f2f-95f9d4deed67',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-915997186',owner_user_name='tempest-AttachSCSIVolumeTestJSON-915997186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f3745f257ba49c4b4de2e51d2d8ec22',uuid=77f4c5de-b6dd-486f-b121-47a08de231a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Converting VIF {"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:14:e7,bridge_name='br-int',has_traffic_filtering=True,id=4ddd1a8f-43f5-4086-8c5f-8bb79c31e355,network=Network(dee6d234-8b41-4ca8-a56d-5eee68069d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ddd1a8f-43') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lazy-loading 'pci_devices' on Instance uuid 77f4c5de-b6dd-486f-b121-47a08de231a9 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:48:22 user nova-compute[75020]:   <uuid>77f4c5de-b6dd-486f-b121-47a08de231a9</uuid>
Nov 30 10:48:22 user nova-compute[75020]:   <name>instance-00000008</name>
Nov 30 10:48:22 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:48:22 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:48:22 user nova-compute[75020]:   <metadata>
Nov 30 10:48:22 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:48:22 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:48:22 user nova-compute[75020]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1430822462</nova:name>
Nov 30 10:48:22 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:48:22</nova:creationTime>
Nov 30 10:48:22 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:48:22 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:48:22 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:48:22 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:48:22 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:48:22 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:48:22 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:48:22 user nova-compute[75020]:       <nova:owner>
Nov 30 10:48:22 user nova-compute[75020]:         <nova:user uuid="8f3745f257ba49c4b4de2e51d2d8ec22">tempest-AttachSCSIVolumeTestJSON-915997186-project-member</nova:user>
Nov 30 10:48:22 user nova-compute[75020]:         <nova:project uuid="fd909ba3afb5482ab3d20c7d56c7c4a0">tempest-AttachSCSIVolumeTestJSON-915997186</nova:project>
Nov 30 10:48:22 user nova-compute[75020]:       </nova:owner>
Nov 30 10:48:22 user nova-compute[75020]:       <nova:root type="image" uuid="309f6f84-3967-469f-8f2f-95f9d4deed67"/>
Nov 30 10:48:22 user nova-compute[75020]:       <nova:ports>
Nov 30 10:48:22 user nova-compute[75020]:         <nova:port uuid="4ddd1a8f-43f5-4086-8c5f-8bb79c31e355">
Nov 30 10:48:22 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 10:48:22 user nova-compute[75020]:         </nova:port>
Nov 30 10:48:22 user nova-compute[75020]:       </nova:ports>
Nov 30 10:48:22 user nova-compute[75020]:     </nova:instance>
Nov 30 10:48:22 user nova-compute[75020]:   </metadata>
Nov 30 10:48:22 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:48:22 user nova-compute[75020]:     <system>
Nov 30 10:48:22 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:48:22 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:48:22 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:48:22 user nova-compute[75020]:       <entry name="serial">77f4c5de-b6dd-486f-b121-47a08de231a9</entry>
Nov 30 10:48:22 user nova-compute[75020]:       <entry name="uuid">77f4c5de-b6dd-486f-b121-47a08de231a9</entry>
Nov 30 10:48:22 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:48:22 user nova-compute[75020]:     </system>
Nov 30 10:48:22 user nova-compute[75020]:   </sysinfo>
Nov 30 10:48:22 user nova-compute[75020]:   <os>
Nov 30 10:48:22 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:48:22 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:48:22 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:48:22 user nova-compute[75020]:   </os>
Nov 30 10:48:22 user nova-compute[75020]:   <features>
Nov 30 10:48:22 user nova-compute[75020]:     <acpi/>
Nov 30 10:48:22 user nova-compute[75020]:     <apic/>
Nov 30 10:48:22 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:48:22 user nova-compute[75020]:   </features>
Nov 30 10:48:22 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:48:22 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:48:22 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:48:22 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:48:22 user nova-compute[75020]:   </clock>
Nov 30 10:48:22 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:48:22 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:48:22 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:48:22 user nova-compute[75020]:   </cpu>
Nov 30 10:48:22 user nova-compute[75020]:   <devices>
Nov 30 10:48:22 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:48:22 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:48:22 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk"/>
Nov 30 10:48:22 user nova-compute[75020]:       <target dev="sda" bus="scsi"/>
Nov 30 10:48:22 user nova-compute[75020]:       <address type="drive" controller="0" unit="0"/>
Nov 30 10:48:22 user nova-compute[75020]:     </disk>
Nov 30 10:48:22 user nova-compute[75020]:     <disk type="file" device="cdrom">
Nov 30 10:48:22 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 10:48:22 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk.config"/>
Nov 30 10:48:22 user nova-compute[75020]:       <target dev="sdb" bus="scsi"/>
Nov 30 10:48:22 user nova-compute[75020]:       <address type="drive" controller="0" unit="1"/>
Nov 30 10:48:22 user nova-compute[75020]:     </disk>
Nov 30 10:48:22 user nova-compute[75020]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 30 10:48:22 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:48:22 user nova-compute[75020]:       <mac address="fa:16:3e:e3:14:e7"/>
Nov 30 10:48:22 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:22 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:48:22 user nova-compute[75020]:       <target dev="tap4ddd1a8f-43"/>
Nov 30 10:48:22 user nova-compute[75020]:     </interface>
Nov 30 10:48:22 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:48:22 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/console.log" append="off"/>
Nov 30 10:48:22 user nova-compute[75020]:     </serial>
Nov 30 10:48:22 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:48:22 user nova-compute[75020]:     <video>
Nov 30 10:48:22 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:22 user nova-compute[75020]:     </video>
Nov 30 10:48:22 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:48:22 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:48:22 user nova-compute[75020]:     </rng>
Nov 30 10:48:22 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:48:22 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:48:22 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:48:22 user nova-compute[75020]:     </memballoon>
Nov 30 10:48:22 user nova-compute[75020]:   </devices>
Nov 30 10:48:22 user nova-compute[75020]: </domain>
Nov 30 10:48:22 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1430822462',display_name='tempest-AttachSCSIVolumeTestJSON-server-1430822462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1430822462',id=8,image_ref='309f6f84-3967-469f-8f2f-95f9d4deed67',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUPjzBzXOz/It6HliXZQj/rzwF2kTEuocy5ZSlrKoe8g+I+k/V3scQBxR3SMkBIIDTfqJMVCcrJOeKPh8ihPL7JalwO4CsaYn4hdZ0yNLx+nKrpmb74zvy2VuyShU280A==',key_name='tempest-keypair-272548173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd909ba3afb5482ab3d20c7d56c7c4a0',ramdisk_id='',reservation_id='r-ljae1e01',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='309f6f84-3967-469f-8f2f-95f9d4deed67',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-915997186',owner_user_name='tempest-AttachSCSIVolumeTestJSON-915997186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f3745f257ba49c4b4de2e51d2d8ec22',uuid=77f4c5de-b6dd-486f-b121-47a08de231a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Converting VIF {"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:14:e7,bridge_name='br-int',has_traffic_filtering=True,id=4ddd1a8f-43f5-4086-8c5f-8bb79c31e355,network=Network(dee6d234-8b41-4ca8-a56d-5eee68069d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ddd1a8f-43') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG os_vif [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:14:e7,bridge_name='br-int',has_traffic_filtering=True,id=4ddd1a8f-43f5-4086-8c5f-8bb79c31e355,network=Network(dee6d234-8b41-4ca8-a56d-5eee68069d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ddd1a8f-43') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f92e48b-b1a7-50f4-b511-b90ffe19f0a0', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ddd1a8f-43, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ddd1a8f-43, col_values=(('qos', UUID('bab12059-fa47-4ffd-bce9-9e40508cc3cd')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ddd1a8f-43, col_values=(('external_ids', {'iface-id': '4ddd1a8f-43f5-4086-8c5f-8bb79c31e355', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:14:e7', 'vm-uuid': '77f4c5de-b6dd-486f-b121-47a08de231a9'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: INFO os_vif [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:14:e7,bridge_name='br-int',has_traffic_filtering=True,id=4ddd1a8f-43f5-4086-8c5f-8bb79c31e355,network=Network(dee6d234-8b41-4ca8-a56d-5eee68069d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ddd1a8f-43')
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] No BDM found with device name sda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] No VIF found with MAC fa:16:3e:e3:14:e7, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:48:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Using config drive
Nov 30 10:48:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Instance spawned successfully.
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Creating config drive at /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk.config
Nov 30 10:48:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp10i6hpmh {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:23 user nova-compute[75020]: INFO nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Took 11.43 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp10i6hpmh" returned: 0 in 0.096s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:23 user nova-compute[75020]: INFO nova.compute.manager [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Took 12.88 seconds to build instance.
Nov 30 10:48:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a933d471-b1c3-4193-bd0b-ed5d2570f20f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.108s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating instance_info_cache with network_info: [{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Releasing lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Instance network_info: |[{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4e4e9015-ee1c-4cf0-b363-34255c38efaf req-c812ccef-a6fd-42a2-9834-ce915646bdeb service nova] Acquired lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-4e4e9015-ee1c-4cf0-b363-34255c38efaf req-c812ccef-a6fd-42a2-9834-ce915646bdeb service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Refreshing network info cache for port e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Start _get_guest_xml network_info=[{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:48:23 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:23 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converting VIF {"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:cd:4e,bridge_name='br-int',has_traffic_filtering=True,id=e6718122-9240-4368-987f-7557ca0ed04a,network=Network(5c8922df-ae24-4441-810f-697d6b1fbcff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6718122-92') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.objects.instance [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lazy-loading 'pci_devices' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:48:23 user nova-compute[75020]:   <uuid>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</uuid>
Nov 30 10:48:23 user nova-compute[75020]:   <name>instance-00000009</name>
Nov 30 10:48:23 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:48:23 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:48:23 user nova-compute[75020]:   <metadata>
Nov 30 10:48:23 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:48:23 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:48:23 user nova-compute[75020]:       <nova:name>tempest-device-tagging-server-737307002</nova:name>
Nov 30 10:48:23 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:48:23</nova:creationTime>
Nov 30 10:48:23 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:48:23 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:48:23 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:48:23 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:48:23 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:48:23 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:48:23 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:48:23 user nova-compute[75020]:       <nova:owner>
Nov 30 10:48:23 user nova-compute[75020]:         <nova:user uuid="f4aa8049f42b46e5b5b8f894c56927be">tempest-TaggedAttachmentsTest-1620533068-project-member</nova:user>
Nov 30 10:48:23 user nova-compute[75020]:         <nova:project uuid="941912a981d343bfa3e50a94195ec953">tempest-TaggedAttachmentsTest-1620533068</nova:project>
Nov 30 10:48:23 user nova-compute[75020]:       </nova:owner>
Nov 30 10:48:23 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:48:23 user nova-compute[75020]:       <nova:ports>
Nov 30 10:48:23 user nova-compute[75020]:         <nova:port uuid="e6718122-9240-4368-987f-7557ca0ed04a">
Nov 30 10:48:23 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 10:48:23 user nova-compute[75020]:         </nova:port>
Nov 30 10:48:23 user nova-compute[75020]:       </nova:ports>
Nov 30 10:48:23 user nova-compute[75020]:     </nova:instance>
Nov 30 10:48:23 user nova-compute[75020]:   </metadata>
Nov 30 10:48:23 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:48:23 user nova-compute[75020]:     <system>
Nov 30 10:48:23 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:48:23 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:48:23 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:48:23 user nova-compute[75020]:       <entry name="serial">f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:48:23 user nova-compute[75020]:       <entry name="uuid">f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:48:23 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:48:23 user nova-compute[75020]:     </system>
Nov 30 10:48:23 user nova-compute[75020]:   </sysinfo>
Nov 30 10:48:23 user nova-compute[75020]:   <os>
Nov 30 10:48:23 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:48:23 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:48:23 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:48:23 user nova-compute[75020]:   </os>
Nov 30 10:48:23 user nova-compute[75020]:   <features>
Nov 30 10:48:23 user nova-compute[75020]:     <acpi/>
Nov 30 10:48:23 user nova-compute[75020]:     <apic/>
Nov 30 10:48:23 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:48:23 user nova-compute[75020]:   </features>
Nov 30 10:48:23 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:48:23 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:48:23 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:48:23 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:48:23 user nova-compute[75020]:   </clock>
Nov 30 10:48:23 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:48:23 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:48:23 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:48:23 user nova-compute[75020]:   </cpu>
Nov 30 10:48:23 user nova-compute[75020]:   <devices>
Nov 30 10:48:23 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:48:23 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:48:23 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk"/>
Nov 30 10:48:23 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:48:23 user nova-compute[75020]:     </disk>
Nov 30 10:48:23 user nova-compute[75020]:     <disk type="file" device="cdrom">
Nov 30 10:48:23 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 10:48:23 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.config"/>
Nov 30 10:48:23 user nova-compute[75020]:       <target dev="hda" bus="ide"/>
Nov 30 10:48:23 user nova-compute[75020]:     </disk>
Nov 30 10:48:23 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:48:23 user nova-compute[75020]:       <mac address="fa:16:3e:dc:cd:4e"/>
Nov 30 10:48:23 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:23 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:48:23 user nova-compute[75020]:       <target dev="tape6718122-92"/>
Nov 30 10:48:23 user nova-compute[75020]:     </interface>
Nov 30 10:48:23 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:48:23 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log" append="off"/>
Nov 30 10:48:23 user nova-compute[75020]:     </serial>
Nov 30 10:48:23 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:48:23 user nova-compute[75020]:     <video>
Nov 30 10:48:23 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:23 user nova-compute[75020]:     </video>
Nov 30 10:48:23 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:48:23 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:48:23 user nova-compute[75020]:     </rng>
Nov 30 10:48:23 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:48:23 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:48:23 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:48:23 user nova-compute[75020]:     </memballoon>
Nov 30 10:48:23 user nova-compute[75020]:   </devices>
Nov 30 10:48:23 user nova-compute[75020]: </domain>
Nov 30 10:48:23 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converting VIF {"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:cd:4e,bridge_name='br-int',has_traffic_filtering=True,id=e6718122-9240-4368-987f-7557ca0ed04a,network=Network(5c8922df-ae24-4441-810f-697d6b1fbcff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6718122-92') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG os_vif [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:cd:4e,bridge_name='br-int',has_traffic_filtering=True,id=e6718122-9240-4368-987f-7557ca0ed04a,network=Network(5c8922df-ae24-4441-810f-697d6b1fbcff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6718122-92') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3d3c78d-7f0b-5fb9-94dc-6ac2dcb1805c', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6718122-92, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6718122-92, col_values=(('qos', UUID('8a86e0af-3dc9-4082-9983-be079edb0a65')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6718122-92, col_values=(('external_ids', {'iface-id': 'e6718122-9240-4368-987f-7557ca0ed04a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:cd:4e', 'vm-uuid': 'f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:23 user nova-compute[75020]: INFO os_vif [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:cd:4e,bridge_name='br-int',has_traffic_filtering=True,id=e6718122-9240-4368-987f-7557ca0ed04a,network=Network(5c8922df-ae24-4441-810f-697d6b1fbcff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6718122-92')
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No BDM found with device name hda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No VIF found with MAC fa:16:3e:dc:cd:4e, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:48:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Using config drive
Nov 30 10:48:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Creating config drive at /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.config
Nov 30 10:48:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn7zfr00k {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-4e4e9015-ee1c-4cf0-b363-34255c38efaf req-c812ccef-a6fd-42a2-9834-ce915646bdeb service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updated VIF entry in instance network info cache for port e6718122-9240-4368-987f-7557ca0ed04a. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:48:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-4e4e9015-ee1c-4cf0-b363-34255c38efaf req-c812ccef-a6fd-42a2-9834-ce915646bdeb service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating instance_info_cache with network_info: [{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn7zfr00k" returned: 0 in 0.063s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4e4e9015-ee1c-4cf0-b363-34255c38efaf req-c812ccef-a6fd-42a2-9834-ce915646bdeb service nova] Releasing lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG nova.compute.manager [req-148ee895-7cf4-4328-9c5c-12e6a1cd5550 req-12d2f713-8914-4803-8538-110f5928459d service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-148ee895-7cf4-4328-9c5c-12e6a1cd5550 req-12d2f713-8914-4803-8538-110f5928459d service nova] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-148ee895-7cf4-4328-9c5c-12e6a1cd5550 req-12d2f713-8914-4803-8538-110f5928459d service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-148ee895-7cf4-4328-9c5c-12e6a1cd5550 req-12d2f713-8914-4803-8538-110f5928459d service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG nova.compute.manager [req-148ee895-7cf4-4328-9c5c-12e6a1cd5550 req-12d2f713-8914-4803-8538-110f5928459d service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] No waiting events found dispatching network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:27 user nova-compute[75020]: WARNING nova.compute.manager [req-148ee895-7cf4-4328-9c5c-12e6a1cd5550 req-12d2f713-8914-4803-8538-110f5928459d service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received unexpected event network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a for instance with vm_state building and task_state spawning.
Nov 30 10:48:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:27 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:48:28 user nova-compute[75020]: INFO nova.compute.claims [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Claim successful on node user
Nov 30 10:48:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.825s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:28 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.network.neutron [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:48:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-25c8d4b8-0fc8-4bf8-852f-89f9acf97276 req-1b4d47ec-f5ce-4a2e-a58b-dd9209394bc3 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-25c8d4b8-0fc8-4bf8-852f-89f9acf97276 req-1b4d47ec-f5ce-4a2e-a58b-dd9209394bc3 service nova] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-25c8d4b8-0fc8-4bf8-852f-89f9acf97276 req-1b4d47ec-f5ce-4a2e-a58b-dd9209394bc3 service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-25c8d4b8-0fc8-4bf8-852f-89f9acf97276 req-1b4d47ec-f5ce-4a2e-a58b-dd9209394bc3 service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-25c8d4b8-0fc8-4bf8-852f-89f9acf97276 req-1b4d47ec-f5ce-4a2e-a58b-dd9209394bc3 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] No waiting events found dispatching network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:29 user nova-compute[75020]: WARNING nova.compute.manager [req-25c8d4b8-0fc8-4bf8-852f-89f9acf97276 req-1b4d47ec-f5ce-4a2e-a58b-dd9209394bc3 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received unexpected event network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a for instance with vm_state building and task_state spawning.
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.policy [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '354173887a794de284f3961995a9eafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e0181762094bd69c9ace796ad893df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:48:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Creating image(s)
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "/opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "/opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "/opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.228s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.257s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk 1073741824" returned: 0 in 0.088s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Instance spawned successfully.
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Instance spawned successfully.
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:30 user nova-compute[75020]: INFO nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Took 14.90 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.271s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:30 user nova-compute[75020]: INFO nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Took 11.07 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:30 user nova-compute[75020]: INFO nova.compute.manager [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Took 16.55 seconds to build instance.
Nov 30 10:48:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5d5548e0-2f48-45f2-a81c-a6164e26b1f4 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.795s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:30 user nova-compute[75020]: INFO nova.compute.manager [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Took 12.72 seconds to build instance.
Nov 30 10:48:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7f60e68e-d448-492f-a4b8-6dac9c3ae686 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.996s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Cannot resize image /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Ensure instance console log exists: /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Successfully created port: d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:48:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 10:48:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 10:48:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 10:48:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.neutron [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Successfully updated port: d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquired lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.neutron [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-ed9b5e27-9fd6-4c59-8cbf-b8ae98a7ea1c req-8c452e8d-04ee-4af1-8f73-05e83a372d42 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received event network-changed-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-ed9b5e27-9fd6-4c59-8cbf-b8ae98a7ea1c req-8c452e8d-04ee-4af1-8f73-05e83a372d42 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Refreshing instance network info cache due to event network-changed-d0ded7d3-ee25-4b88-81d7-e74f82502ea1. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ed9b5e27-9fd6-4c59-8cbf-b8ae98a7ea1c req-8c452e8d-04ee-4af1-8f73-05e83a372d42 service nova] Acquiring lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.neutron [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.neutron [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Updating instance_info_cache with network_info: [{"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Releasing lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Instance network_info: |[{"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ed9b5e27-9fd6-4c59-8cbf-b8ae98a7ea1c req-8c452e8d-04ee-4af1-8f73-05e83a372d42 service nova] Acquired lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.neutron [req-ed9b5e27-9fd6-4c59-8cbf-b8ae98a7ea1c req-8c452e8d-04ee-4af1-8f73-05e83a372d42 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Refreshing network info cache for port d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Start _get_guest_xml network_info=[{"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:48:33 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:33 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-419067090',display_name='tempest-VolumesAssistedSnapshotsTest-server-419067090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-419067090',id=10,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOPJzvxOqxd0Hahpg/ZLlZ30MG76BH8iJzVEdoHOt9UFsUiG6OuTZg+FjRRwqF9/pD4dXjGwGr1eevoH/eFDwk9s38l7PdZwpUViPmUoEUZ0i5aTRIP3AmFfpApn2Fegw==',key_name='tempest-keypair-742596868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5e0181762094bd69c9ace796ad893df',ramdisk_id='',reservation_id='r-s799svrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1195989046',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1195989046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354173887a794de284f3961995a9eafb',uuid=546b1a78-e8e9-40ac-ad39-c4eaa1539f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Converting VIF {"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:45:44,bridge_name='br-int',has_traffic_filtering=True,id=d0ded7d3-ee25-4b88-81d7-e74f82502ea1,network=Network(156a321e-54e7-4c4b-a201-24ca5dbad218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ded7d3-ee') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.objects.instance [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lazy-loading 'pci_devices' on Instance uuid 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:48:33 user nova-compute[75020]:   <uuid>546b1a78-e8e9-40ac-ad39-c4eaa1539f91</uuid>
Nov 30 10:48:33 user nova-compute[75020]:   <name>instance-0000000a</name>
Nov 30 10:48:33 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:48:33 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:48:33 user nova-compute[75020]:   <metadata>
Nov 30 10:48:33 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:48:33 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:48:33 user nova-compute[75020]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-419067090</nova:name>
Nov 30 10:48:33 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:48:33</nova:creationTime>
Nov 30 10:48:33 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:48:33 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:48:33 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:48:33 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:48:33 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:48:33 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:48:33 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:48:33 user nova-compute[75020]:       <nova:owner>
Nov 30 10:48:33 user nova-compute[75020]:         <nova:user uuid="354173887a794de284f3961995a9eafb">tempest-VolumesAssistedSnapshotsTest-1195989046-project-member</nova:user>
Nov 30 10:48:33 user nova-compute[75020]:         <nova:project uuid="e5e0181762094bd69c9ace796ad893df">tempest-VolumesAssistedSnapshotsTest-1195989046</nova:project>
Nov 30 10:48:33 user nova-compute[75020]:       </nova:owner>
Nov 30 10:48:33 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:48:33 user nova-compute[75020]:       <nova:ports>
Nov 30 10:48:33 user nova-compute[75020]:         <nova:port uuid="d0ded7d3-ee25-4b88-81d7-e74f82502ea1">
Nov 30 10:48:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 10:48:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:48:33 user nova-compute[75020]:       </nova:ports>
Nov 30 10:48:33 user nova-compute[75020]:     </nova:instance>
Nov 30 10:48:33 user nova-compute[75020]:   </metadata>
Nov 30 10:48:33 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:48:33 user nova-compute[75020]:     <system>
Nov 30 10:48:33 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:48:33 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:48:33 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:48:33 user nova-compute[75020]:       <entry name="serial">546b1a78-e8e9-40ac-ad39-c4eaa1539f91</entry>
Nov 30 10:48:33 user nova-compute[75020]:       <entry name="uuid">546b1a78-e8e9-40ac-ad39-c4eaa1539f91</entry>
Nov 30 10:48:33 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:48:33 user nova-compute[75020]:     </system>
Nov 30 10:48:33 user nova-compute[75020]:   </sysinfo>
Nov 30 10:48:33 user nova-compute[75020]:   <os>
Nov 30 10:48:33 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:48:33 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:48:33 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:48:33 user nova-compute[75020]:   </os>
Nov 30 10:48:33 user nova-compute[75020]:   <features>
Nov 30 10:48:33 user nova-compute[75020]:     <acpi/>
Nov 30 10:48:33 user nova-compute[75020]:     <apic/>
Nov 30 10:48:33 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:48:33 user nova-compute[75020]:   </features>
Nov 30 10:48:33 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:48:33 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:48:33 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:48:33 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:48:33 user nova-compute[75020]:   </clock>
Nov 30 10:48:33 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:48:33 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:48:33 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:48:33 user nova-compute[75020]:   </cpu>
Nov 30 10:48:33 user nova-compute[75020]:   <devices>
Nov 30 10:48:33 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:48:33 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:48:33 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk"/>
Nov 30 10:48:33 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:48:33 user nova-compute[75020]:     </disk>
Nov 30 10:48:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:48:33 user nova-compute[75020]:       <mac address="fa:16:3e:9e:45:44"/>
Nov 30 10:48:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:48:33 user nova-compute[75020]:       <target dev="tapd0ded7d3-ee"/>
Nov 30 10:48:33 user nova-compute[75020]:     </interface>
Nov 30 10:48:33 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:48:33 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/console.log" append="off"/>
Nov 30 10:48:33 user nova-compute[75020]:     </serial>
Nov 30 10:48:33 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:48:33 user nova-compute[75020]:     <video>
Nov 30 10:48:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:48:33 user nova-compute[75020]:     </video>
Nov 30 10:48:33 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:48:33 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:48:33 user nova-compute[75020]:     </rng>
Nov 30 10:48:33 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:48:33 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:48:33 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:48:33 user nova-compute[75020]:     </memballoon>
Nov 30 10:48:33 user nova-compute[75020]:   </devices>
Nov 30 10:48:33 user nova-compute[75020]: </domain>
Nov 30 10:48:33 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-419067090',display_name='tempest-VolumesAssistedSnapshotsTest-server-419067090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-419067090',id=10,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOPJzvxOqxd0Hahpg/ZLlZ30MG76BH8iJzVEdoHOt9UFsUiG6OuTZg+FjRRwqF9/pD4dXjGwGr1eevoH/eFDwk9s38l7PdZwpUViPmUoEUZ0i5aTRIP3AmFfpApn2Fegw==',key_name='tempest-keypair-742596868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5e0181762094bd69c9ace796ad893df',ramdisk_id='',reservation_id='r-s799svrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1195989046',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1195989046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354173887a794de284f3961995a9eafb',uuid=546b1a78-e8e9-40ac-ad39-c4eaa1539f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Converting VIF {"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:45:44,bridge_name='br-int',has_traffic_filtering=True,id=d0ded7d3-ee25-4b88-81d7-e74f82502ea1,network=Network(156a321e-54e7-4c4b-a201-24ca5dbad218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ded7d3-ee') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG os_vif [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:45:44,bridge_name='br-int',has_traffic_filtering=True,id=d0ded7d3-ee25-4b88-81d7-e74f82502ea1,network=Network(156a321e-54e7-4c4b-a201-24ca5dbad218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ded7d3-ee') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79e70baf-5b06-5c10-99ea-6868a6cf4a3d', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ded7d3-ee, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ded7d3-ee, col_values=(('qos', UUID('405f7dfc-b1dc-4e37-93e4-ced278be07e1')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ded7d3-ee, col_values=(('external_ids', {'iface-id': 'd0ded7d3-ee25-4b88-81d7-e74f82502ea1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:45:44', 'vm-uuid': '546b1a78-e8e9-40ac-ad39-c4eaa1539f91'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:34 user nova-compute[75020]: INFO os_vif [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:45:44,bridge_name='br-int',has_traffic_filtering=True,id=d0ded7d3-ee25-4b88-81d7-e74f82502ea1,network=Network(156a321e-54e7-4c4b-a201-24ca5dbad218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ded7d3-ee')
Nov 30 10:48:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] No VIF found with MAC fa:16:3e:9e:45:44, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG nova.network.neutron [req-ed9b5e27-9fd6-4c59-8cbf-b8ae98a7ea1c req-8c452e8d-04ee-4af1-8f73-05e83a372d42 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Updated VIF entry in instance network info cache for port d0ded7d3-ee25-4b88-81d7-e74f82502ea1. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG nova.network.neutron [req-ed9b5e27-9fd6-4c59-8cbf-b8ae98a7ea1c req-8c452e8d-04ee-4af1-8f73-05e83a372d42 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Updating instance_info_cache with network_info: [{"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ed9b5e27-9fd6-4c59-8cbf-b8ae98a7ea1c req-8c452e8d-04ee-4af1-8f73-05e83a372d42 service nova] Releasing lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] No waiting events found dispatching network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:35 user nova-compute[75020]: WARNING nova.compute.manager [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received unexpected event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f for instance with vm_state active and task_state None.
Nov 30 10:48:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] No waiting events found dispatching network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:35 user nova-compute[75020]: WARNING nova.compute.manager [req-71b1ce4b-3998-4b53-b568-187d1c3f5b8e req-7ee1c15b-cb8b-48f7-a6ec-f9e423895eb2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received unexpected event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f for instance with vm_state active and task_state None.
Nov 30 10:48:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:48:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Instance spawned successfully.
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:48:38 user nova-compute[75020]: INFO nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Took 9.32 seconds to spawn the instance on the hypervisor.
Nov 30 10:48:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:48:38 user nova-compute[75020]: INFO nova.compute.manager [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Took 10.71 seconds to build instance.
Nov 30 10:48:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3bb1dc49-bafe-4beb-895f-e430562e075b tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.886s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-60f23648-533f-4150-93e3-6bccfc189638 req-e5ef05c8-c67f-4ba3-9512-465d0d413a2e service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received event network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60f23648-533f-4150-93e3-6bccfc189638 req-e5ef05c8-c67f-4ba3-9512-465d0d413a2e service nova] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60f23648-533f-4150-93e3-6bccfc189638 req-e5ef05c8-c67f-4ba3-9512-465d0d413a2e service nova] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60f23648-533f-4150-93e3-6bccfc189638 req-e5ef05c8-c67f-4ba3-9512-465d0d413a2e service nova] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-60f23648-533f-4150-93e3-6bccfc189638 req-e5ef05c8-c67f-4ba3-9512-465d0d413a2e service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] No waiting events found dispatching network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:41 user nova-compute[75020]: WARNING nova.compute.manager [req-60f23648-533f-4150-93e3-6bccfc189638 req-e5ef05c8-c67f-4ba3-9512-465d0d413a2e service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received unexpected event network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 for instance with vm_state active and task_state None.
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received event network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] No waiting events found dispatching network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:43 user nova-compute[75020]: WARNING nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received unexpected event network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 for instance with vm_state active and task_state None.
Nov 30 10:48:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received event network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] No waiting events found dispatching network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:43 user nova-compute[75020]: WARNING nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received unexpected event network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 for instance with vm_state active and task_state None.
Nov 30 10:48:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received event network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] No waiting events found dispatching network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:48:43 user nova-compute[75020]: WARNING nova.compute.manager [req-4d321edd-c918-4dcb-8820-de6f8bd63809 req-db8d0cdf-86aa-479b-ad88-ce4a09a58b14 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received unexpected event network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 for instance with vm_state active and task_state None.
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:48:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:44 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:44 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7310MB free_disk=25.651588439941406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 134d8045-4c59-429d-9c01-6c451f0fa58b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a709433f-c094-4726-8498-c508e14f9d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 88815763-252f-4506-aa0c-5524e8b96e08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77a73463-ea12-43c3-83a4-803f4a535010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77f4c5de-b6dd-486f-b121-47a08de231a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 10:48:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 10:48:45 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:48:45 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:48:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:48:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.116s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:48:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:48:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:48:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:48:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:48:46 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid d88214a8-f7f1-4735-8faf-611d70a77d9f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updating instance_info_cache with network_info: [{"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:48:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:48:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:48:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:48:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:48:58 user nova-compute[75020]: INFO nova.compute.claims [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Claim successful on node user
Nov 30 10:48:59 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:48:59 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:48:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:48:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:48:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:48:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:48:59 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:48:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:48:59 user nova-compute[75020]: INFO nova.virt.block_device [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Booting with volume c485241a-d3ce-4f5f-8e36-c5097afa4bb6 at /dev/vda
Nov 30 10:48:59 user nova-compute[75020]: DEBUG nova.policy [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a98bf8422cf74974bd47a93336341358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f5aac1ca93428ca3e43a1f79fd832a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:48:59 user nova-compute[75020]: DEBUG os_brick.utils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:48:59 user nova-compute[75020]: INFO oslo.privsep.daemon [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpm_xjdh0w/privsep.sock']
Nov 30 10:48:59 user sudo[86367]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpm_xjdh0w/privsep.sock
Nov 30 10:48:59 user sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 10:49:00 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully created port: 6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully created port: 0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:49:01 user sudo[86367]: pam_unix(sudo:session): session closed for user root
Nov 30 10:49:01 user nova-compute[75020]: INFO oslo.privsep.daemon [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Spawned new privsep daemon via rootwrap
Nov 30 10:49:01 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 10:49:01 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 10:49:01 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 30 10:49:01 user nova-compute[75020]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86371
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1526b3-0e55-497c-aa46-98d33fbe67c5]: (2,) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75a26dc-36d1-4dfb-a8cb-2e7e760fdd24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:01 user nova-compute[75020]: WARNING os_brick.initiator.connectors.nvmeof [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully created port: fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a007dc05-18ae-494e-b5a8-028eb38e4259]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[423c5481-1064-4b26-99f0-5f322395104d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3a06f9-8d4f-4dd6-a87e-710ab6f8bae9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:01 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:49:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2daa4b-875d-4221-8538-9e01eca60edd]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG os_brick.utils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== get_connector_properties: return (1916ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:01 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating existing volume attachment record: 398c489d-d634-4880-bf55-2bab2da56a5c {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:49:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully created port: 7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:49:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully created port: e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:49:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully updated port: 6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-4489633a-a857-405a-9b4c-990c69c21ac8 req-f564b602-7a49-4fdd-b88d-c9b21fafc4e4 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-changed-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-4489633a-a857-405a-9b4c-990c69c21ac8 req-f564b602-7a49-4fdd-b88d-c9b21fafc4e4 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing instance network info cache due to event network-changed-6d05c95f-4b7a-4397-a4a2-0940c89403d7. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4489633a-a857-405a-9b4c-990c69c21ac8 req-f564b602-7a49-4fdd-b88d-c9b21fafc4e4 service nova] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4489633a-a857-405a-9b4c-990c69c21ac8 req-f564b602-7a49-4fdd-b88d-c9b21fafc4e4 service nova] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-4489633a-a857-405a-9b4c-990c69c21ac8 req-f564b602-7a49-4fdd-b88d-c9b21fafc4e4 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing network info cache for port 6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-4489633a-a857-405a-9b4c-990c69c21ac8 req-f564b602-7a49-4fdd-b88d-c9b21fafc4e4 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-4489633a-a857-405a-9b4c-990c69c21ac8 req-f564b602-7a49-4fdd-b88d-c9b21fafc4e4 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4489633a-a857-405a-9b4c-990c69c21ac8 req-f564b602-7a49-4fdd-b88d-c9b21fafc4e4 service nova] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully updated port: 15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:49:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:04 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully updated port: db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully updated port: 0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-changed-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing instance network info cache due to event network-changed-15aee499-aa82-456a-832e-217fe9dd590e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing network info cache for port 15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-changed-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing instance network info cache due to event network-changed-db40c00e-b7c2-42a8-9010-2bb48467c1fb. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing network info cache for port db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully updated port: fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-changed-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing instance network info cache due to event network-changed-0345f742-a081-4244-b874-54667cd790dd. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing network info cache for port 0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:49:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9ce5aafc-17af-4706-b0d4-ceb12d2810e3 req-434a8384-2b8b-4ad5-9078-633d0ba2ddf3 service nova] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully updated port: 7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:49:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Successfully updated port: e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:49:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:49:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:49:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-changed-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing instance network info cache due to event network-changed-fa7b73e3-b623-474f-a636-164d67d9029d. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance network_info: |[{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing network info cache for port fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updated VIF entry in instance network info cache for port fa7b73e3-b623-474f-a636-164d67d9029d. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-changed-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing instance network info cache due to event network-changed-7a9ded10-59fc-429b-a08c-cb8282d20238. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing network info cache for port 7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updated VIF entry in instance network info cache for port 7a9ded10-59fc-429b-a08c-cb8282d20238. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-changed-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing instance network info cache due to event network-changed-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:09 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing network info cache for port e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updated VIF entry in instance network info cache for port e72d127f-f4ce-4595-9cb8-f30e6ebed2d7. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG nova.network.neutron [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35a0df7f-df32-4228-956f-d300272761c8 req-b3df3a52-6f14-443b-9e63-085d42086f4a service nova] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:10 user nova-compute[75020]: INFO nova.virt.block_device [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Booting with volume eabfdc11-d002-41bc-b708-dbb60ba404be at /dev/vdb
Nov 30 10:49:10 user nova-compute[75020]: DEBUG os_brick.utils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e5d59a-110c-4014-b8e5-fb3799732de7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1905d8f-e9f2-42e3-92ae-e634684943ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46d99ca-4169-4dd2-94d1-8589a852819b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b5c61c-5500-40e1-9406-0ab2e3c1467e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:10 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:49:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e3a337-5917-4847-8eef-c54167ab463f]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG os_brick.utils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:10 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating existing volume attachment record: 719fb393-ae86-4788-b065-fe6f782b9182 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:49:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:19 user nova-compute[75020]: INFO nova.virt.block_device [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Booting with volume 363f5d5c-f690-4f66-b660-b5a25009605c at /dev/vdc
Nov 30 10:49:19 user nova-compute[75020]: DEBUG os_brick.utils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2288318-8ced-49b1-a8e6-2dab0ec17ac8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2603392-08b1-4679-a688-fb12f5825d32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:19 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b96dc6-5b18-4979-a1d3-52f7c3004ffc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279d390-f3e2-4734-b506-858992b11874]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:20 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:49:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c27c7c5-16ba-4711-b532-54eec235f53d]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG os_brick.utils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:20 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating existing volume attachment record: 14f5b4cc-5df9-45c0-a5d2-ec323313f733 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:49:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:28 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:49:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:28 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:49:28 user nova-compute[75020]: INFO nova.compute.claims [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Claim successful on node user
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:49:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Creating image(s)
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Ensure instance console log exists: /opt/stack/data/nova/instances/a9ad945a-9ce1-4d42-888c-18e660b9d67c/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Start _get_guest_xml network_info=[{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '398c489d-d634-4880-bf55-2bab2da56a5c', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GbVZWFuI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c485241a-d3ce-4f5f-8e36-c5097afa4bb6', 'serial': 'c485241a-d3ce-4f5f-8e36-c5097afa4bb6'}, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '719fb393-ae86-4788-b065-fe6f782b9182', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzpGUqAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c', 'attached_at': '', 'detached_at': '', 'volume_id': 'eabfdc11-d002-41bc-b708-dbb60ba404be', 'serial': 'eabfdc11-d002-41bc-b708-dbb60ba404be'}, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '14f5b4cc-5df9-45c0-a5d2-ec323313f733', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJEhjyWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c', 'attached_at': '', 'detached_at': '', 'volume_id': '363f5d5c-f690-4f66-b660-b5a25009605c', 'serial': '363f5d5c-f690-4f66-b660-b5a25009605c'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:49:29 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:49:29 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connector [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Factory for ISCSI on None {{(pid=75020) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GbVZWFuI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:29 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:29 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:29 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6d6e8f-7a98-49df-9ddd-f0316e998645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:49:29 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d18e0-8efe-4a52-b155-40c2d146de01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6] added
Nov 30 10:49:29 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab343d95-7df6-49e9-ab37-a602c8dad09c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c18d4-6993-43cf-80fd-e8b29af46778]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GbVZWFuI {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GbVZWFuI" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb2619-8d3c-45f2-9873-b0d32d08dfcc]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GbVZWFuI'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[706fa577-0fd8-4a38-94bd-3b7a33091c29]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b5735-92bd-4d0f-b9dd-67f13136be7e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:49:29 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 10:49:29 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:29 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 10:49:29 user nova-compute[75020]: 
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db199ce-c699-45bb-9d71-0e92eabbbf71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6, portal: 172.16.0.220,3260]
Nov 30 10:49:29 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6, portal: 172.16.0.220,3260] successful.
Nov 30 10:49:29 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4abb40b-ccb2-4d24-b3ba-5df0f6514938]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[13db52c7-2fb8-490b-ae03-81a9af44b3ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.network.neutron [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:29 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:29 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bcba6b-c977-45e0-9128-aec378c3eab7]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GbVZWFuI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.policy [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a009178fb2d84a0bac92dc8e018ef987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71024222b364cd287b085eb0b55d90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:49:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Creating image(s)
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "/opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "/opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "/opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.212s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk 1073741824" returned: 0 in 0.051s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Successfully created port: 1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Cannot resize image /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Ensure instance console log exists: /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26332356463316365', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332356463316365', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzpGUqAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:30 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:30 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:30 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff2741-287d-4b1e-8d2c-1448818c77c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:49:30 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4431c0c-5c65-4cc3-9809-b5b782c2a5c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be] added
Nov 30 10:49:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c2d350-3abb-4a32-897f-3a6363f4d0ca]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[270f6ef1-7335-4276-acc7-f1bf0e0a075a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzpGUqAl {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzpGUqAl" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[318ea201-fb29-4ac0-9e32-91375684b2be]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VzpGUqAl'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[87334d23-d74d-4462-8a1e-d64cd14a6be0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca71b91c-1c62-4648-b654-bc72e7322a64]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8291be76-81de-492f-8fbf-b98c1edc6249]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be, portal: 172.16.0.220,3260]
Nov 30 10:49:30 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be, portal: 172.16.0.220,3260] successful.
Nov 30 10:49:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf9921-3466-4eea-8d7b-49f43b052413]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cf9d75-ac2d-4ad0-b72b-5aa838953f4d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:30 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:30 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[989aff56-7a23-43e7-9727-7ac6e8774cbf]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:49:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzpGUqAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Successfully updated port: 1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquired lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-00b141d0-5bc1-4fcb-b947-2c2101b5f72b req-27ba7972-34ba-4a4e-8fa4-d2915b1c1ed1 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received event network-changed-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-00b141d0-5bc1-4fcb-b947-2c2101b5f72b req-27ba7972-34ba-4a4e-8fa4-d2915b1c1ed1 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Refreshing instance network info cache due to event network-changed-1d101f28-52a3-478f-adc4-58faea79f485. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-00b141d0-5bc1-4fcb-b947-2c2101b5f72b req-27ba7972-34ba-4a4e-8fa4-d2915b1c1ed1 service nova] Acquiring lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating instance_info_cache with network_info: [{"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Releasing lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Instance network_info: |[{"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-00b141d0-5bc1-4fcb-b947-2c2101b5f72b req-27ba7972-34ba-4a4e-8fa4-d2915b1c1ed1 service nova] Acquired lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-00b141d0-5bc1-4fcb-b947-2c2101b5f72b req-27ba7972-34ba-4a4e-8fa4-d2915b1c1ed1 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Refreshing network info cache for port 1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Start _get_guest_xml network_info=[{"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:49:31 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:49:31 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1171281107',display_name='tempest-SnapshotDataIntegrityTests-server-1171281107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1171281107',id=12,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEyicSDWqKhGmXc0rx5ioD5/OQqskzA1wXVFH2Fp7PlRtjEsr9R4Pt+pjzLE4DXCKQmFO5FUYlr7Xx0lXuR6boSWh7aXBhMVABMQWgMgGJYImyE5kb6ElUHIVbbBcmvCQ==',key_name='tempest-keypair-1058685710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c71024222b364cd287b085eb0b55d90f',ramdisk_id='',reservation_id='r-muc48z2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1856061136',owner_user_name='tempest-SnapshotDataIntegrityTests-1856061136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a009178fb2d84a0bac92dc8e018ef987',uuid=afb7644a-9d91-4a5e-a75c-6d55a0d158d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Converting VIF {"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:aa,bridge_name='br-int',has_traffic_filtering=True,id=1d101f28-52a3-478f-adc4-58faea79f485,network=Network(f69563f4-a092-4a0a-b974-38a7f1885026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d101f28-52') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.objects.instance [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'pci_devices' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:49:31 user nova-compute[75020]:   <uuid>afb7644a-9d91-4a5e-a75c-6d55a0d158d2</uuid>
Nov 30 10:49:31 user nova-compute[75020]:   <name>instance-0000000c</name>
Nov 30 10:49:31 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:49:31 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:49:31 user nova-compute[75020]:   <metadata>
Nov 30 10:49:31 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:49:31 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:49:31 user nova-compute[75020]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1171281107</nova:name>
Nov 30 10:49:31 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:49:31</nova:creationTime>
Nov 30 10:49:31 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:49:31 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:49:31 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:49:31 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:49:31 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:49:31 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:49:31 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:49:31 user nova-compute[75020]:       <nova:owner>
Nov 30 10:49:31 user nova-compute[75020]:         <nova:user uuid="a009178fb2d84a0bac92dc8e018ef987">tempest-SnapshotDataIntegrityTests-1856061136-project-member</nova:user>
Nov 30 10:49:31 user nova-compute[75020]:         <nova:project uuid="c71024222b364cd287b085eb0b55d90f">tempest-SnapshotDataIntegrityTests-1856061136</nova:project>
Nov 30 10:49:31 user nova-compute[75020]:       </nova:owner>
Nov 30 10:49:31 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:49:31 user nova-compute[75020]:       <nova:ports>
Nov 30 10:49:31 user nova-compute[75020]:         <nova:port uuid="1d101f28-52a3-478f-adc4-58faea79f485">
Nov 30 10:49:31 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 10:49:31 user nova-compute[75020]:         </nova:port>
Nov 30 10:49:31 user nova-compute[75020]:       </nova:ports>
Nov 30 10:49:31 user nova-compute[75020]:     </nova:instance>
Nov 30 10:49:31 user nova-compute[75020]:   </metadata>
Nov 30 10:49:31 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:49:31 user nova-compute[75020]:     <system>
Nov 30 10:49:31 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:49:31 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:49:31 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:49:31 user nova-compute[75020]:       <entry name="serial">afb7644a-9d91-4a5e-a75c-6d55a0d158d2</entry>
Nov 30 10:49:31 user nova-compute[75020]:       <entry name="uuid">afb7644a-9d91-4a5e-a75c-6d55a0d158d2</entry>
Nov 30 10:49:31 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:49:31 user nova-compute[75020]:     </system>
Nov 30 10:49:31 user nova-compute[75020]:   </sysinfo>
Nov 30 10:49:31 user nova-compute[75020]:   <os>
Nov 30 10:49:31 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:49:31 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:49:31 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:49:31 user nova-compute[75020]:   </os>
Nov 30 10:49:31 user nova-compute[75020]:   <features>
Nov 30 10:49:31 user nova-compute[75020]:     <acpi/>
Nov 30 10:49:31 user nova-compute[75020]:     <apic/>
Nov 30 10:49:31 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:49:31 user nova-compute[75020]:   </features>
Nov 30 10:49:31 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:49:31 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:49:31 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:49:31 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:49:31 user nova-compute[75020]:   </clock>
Nov 30 10:49:31 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:49:31 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:49:31 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:49:31 user nova-compute[75020]:   </cpu>
Nov 30 10:49:31 user nova-compute[75020]:   <devices>
Nov 30 10:49:31 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:49:31 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:49:31 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk"/>
Nov 30 10:49:31 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:49:31 user nova-compute[75020]:     </disk>
Nov 30 10:49:31 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:49:31 user nova-compute[75020]:       <mac address="fa:16:3e:09:53:aa"/>
Nov 30 10:49:31 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:31 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:49:31 user nova-compute[75020]:       <target dev="tap1d101f28-52"/>
Nov 30 10:49:31 user nova-compute[75020]:     </interface>
Nov 30 10:49:31 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:49:31 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/console.log" append="off"/>
Nov 30 10:49:31 user nova-compute[75020]:     </serial>
Nov 30 10:49:31 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:49:31 user nova-compute[75020]:     <video>
Nov 30 10:49:31 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:31 user nova-compute[75020]:     </video>
Nov 30 10:49:31 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:49:31 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:49:31 user nova-compute[75020]:     </rng>
Nov 30 10:49:31 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:49:31 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:49:31 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:49:31 user nova-compute[75020]:     </memballoon>
Nov 30 10:49:31 user nova-compute[75020]:   </devices>
Nov 30 10:49:31 user nova-compute[75020]: </domain>
Nov 30 10:49:31 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1171281107',display_name='tempest-SnapshotDataIntegrityTests-server-1171281107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1171281107',id=12,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEyicSDWqKhGmXc0rx5ioD5/OQqskzA1wXVFH2Fp7PlRtjEsr9R4Pt+pjzLE4DXCKQmFO5FUYlr7Xx0lXuR6boSWh7aXBhMVABMQWgMgGJYImyE5kb6ElUHIVbbBcmvCQ==',key_name='tempest-keypair-1058685710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c71024222b364cd287b085eb0b55d90f',ramdisk_id='',reservation_id='r-muc48z2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1856061136',owner_user_name='tempest-SnapshotDataIntegrityTests-1856061136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a009178fb2d84a0bac92dc8e018ef987',uuid=afb7644a-9d91-4a5e-a75c-6d55a0d158d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Converting VIF {"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:aa,bridge_name='br-int',has_traffic_filtering=True,id=1d101f28-52a3-478f-adc4-58faea79f485,network=Network(f69563f4-a092-4a0a-b974-38a7f1885026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d101f28-52') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_vif [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:aa,bridge_name='br-int',has_traffic_filtering=True,id=1d101f28-52a3-478f-adc4-58faea79f485,network=Network(f69563f4-a092-4a0a-b974-38a7f1885026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d101f28-52') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fb704f2-1221-53c5-9298-e5ec991bc4aa', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d101f28-52, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d101f28-52, col_values=(('qos', UUID('9f839a71-0c9c-4f22-83ed-45c2e9b948c9')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d101f28-52, col_values=(('external_ids', {'iface-id': '1d101f28-52a3-478f-adc4-58faea79f485', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:53:aa', 'vm-uuid': 'afb7644a-9d91-4a5e-a75c-6d55a0d158d2'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:31 user nova-compute[75020]: INFO os_vif [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:aa,bridge_name='br-int',has_traffic_filtering=True,id=1d101f28-52a3-478f-adc4-58faea79f485,network=Network(f69563f4-a092-4a0a-b974-38a7f1885026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d101f28-52')
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No VIF found with MAC fa:16:3e:09:53:aa, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-00b141d0-5bc1-4fcb-b947-2c2101b5f72b req-27ba7972-34ba-4a4e-8fa4-d2915b1c1ed1 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updated VIF entry in instance network info cache for port 1d101f28-52a3-478f-adc4-58faea79f485. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-00b141d0-5bc1-4fcb-b947-2c2101b5f72b req-27ba7972-34ba-4a4e-8fa4-d2915b1c1ed1 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating instance_info_cache with network_info: [{"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-00b141d0-5bc1-4fcb-b947-2c2101b5f72b req-27ba7972-34ba-4a4e-8fa4-d2915b1c1ed1 service nova] Releasing lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26631646339396165', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631646339396165', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJEhjyWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:31 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:31 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:31 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdef534-456d-4581-94fa-e276fe89374a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:49:31 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a464eddc-a477-48f4-baa2-fde029b0bbd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c] added
Nov 30 10:49:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0642ad3-8c8b-4266-8d21-c69a5f84dee1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96c2b37-1df3-474c-9b5b-5ff0385f8cd9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJEhjyWB {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJEhjyWB" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263249f-7133-4e11-8c60-3265c2181b6c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJEhjyWB'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fbb477-16ba-48fe-b1a5-5a94d7931a2c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f151f3-883b-48c8-b69c-88162c678e54]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:32 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:32 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5705c90-0f3a-4da4-8808-41c1dd7f6fa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c, portal: 172.16.0.220,3260]
Nov 30 10:49:32 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c, portal: 172.16.0.220,3260] successful.
Nov 30 10:49:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6e29aa-af1b-4b59-a7e2-34de174615b2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[df983fec-03af-49ca-af58-c29b5357e6ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:32 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:32 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:32 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:32 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7fe062-9cc6-45d0-82b4-e52999a697f6]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJEhjyWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-f06707d7-f71f-41be-bd93-5b7e7729babe req-d6fa1a8c-439e-4acf-ab72-a3dbe2eb8f4e service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received event network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f06707d7-f71f-41be-bd93-5b7e7729babe req-d6fa1a8c-439e-4acf-ab72-a3dbe2eb8f4e service nova] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f06707d7-f71f-41be-bd93-5b7e7729babe req-d6fa1a8c-439e-4acf-ab72-a3dbe2eb8f4e service nova] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f06707d7-f71f-41be-bd93-5b7e7729babe req-d6fa1a8c-439e-4acf-ab72-a3dbe2eb8f4e service nova] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-f06707d7-f71f-41be-bd93-5b7e7729babe req-d6fa1a8c-439e-4acf-ab72-a3dbe2eb8f4e service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] No waiting events found dispatching network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:33 user nova-compute[75020]: WARNING nova.compute.manager [req-f06707d7-f71f-41be-bd93-5b7e7729babe req-d6fa1a8c-439e-4acf-ab72-a3dbe2eb8f4e service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received unexpected event network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 for instance with vm_state building and task_state spawning.
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23866326330323562', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866326330323562', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d05c95f-4b7a-4397-a4a2-0940c89403d7,network=Network(137e30f8-3d94-4216-b53e-47ecc1bed798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05c95f-4b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:78:ed,bridge_name='br-int',has_traffic_filtering=True,id=15aee499-aa82-456a-832e-217fe9dd590e,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15aee499-aa') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:22,bridge_name='br-int',has_traffic_filtering=True,id=db40c00e-b7c2-42a8-9010-2bb48467c1fb,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb40c00e-b7') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=0345f742-a081-4244-b874-54667cd790dd,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0345f742-a0') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:de,bridge_name='br-int',has_traffic_filtering=True,id=fa7b73e3-b623-474f-a636-164d67d9029d,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b73e3-b6') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=7a9ded10-59fc-429b-a08c-cb8282d20238,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ded10-59') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6d:c8,bridge_name='br-int',has_traffic_filtering=True,id=e72d127f-f4ce-4595-9cb8-f30e6ebed2d7,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72d127f-f4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.objects.instance [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lazy-loading 'pci_devices' on Instance uuid a9ad945a-9ce1-4d42-888c-18e660b9d67c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:49:33 user nova-compute[75020]:   <uuid>a9ad945a-9ce1-4d42-888c-18e660b9d67c</uuid>
Nov 30 10:49:33 user nova-compute[75020]:   <name>instance-0000000b</name>
Nov 30 10:49:33 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:49:33 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:49:33 user nova-compute[75020]:   <metadata>
Nov 30 10:49:33 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:49:33 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:49:33 user nova-compute[75020]:       <nova:name>tempest-device-tagging-server-801034793</nova:name>
Nov 30 10:49:33 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:49:29</nova:creationTime>
Nov 30 10:49:33 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:49:33 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:49:33 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:49:33 user nova-compute[75020]:       <nova:owner>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:user uuid="a98bf8422cf74974bd47a93336341358">tempest-TaggedBootDevicesTest_v242-1465260125-project-member</nova:user>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:project uuid="17f5aac1ca93428ca3e43a1f79fd832a">tempest-TaggedBootDevicesTest_v242-1465260125</nova:project>
Nov 30 10:49:33 user nova-compute[75020]:       </nova:owner>
Nov 30 10:49:33 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:49:33 user nova-compute[75020]:       <nova:ports>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:port uuid="6d05c95f-4b7a-4397-a4a2-0940c89403d7">
Nov 30 10:49:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 10:49:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:port uuid="15aee499-aa82-456a-832e-217fe9dd590e">
Nov 30 10:49:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Nov 30 10:49:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:port uuid="db40c00e-b7c2-42a8-9010-2bb48467c1fb">
Nov 30 10:49:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Nov 30 10:49:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:port uuid="0345f742-a081-4244-b874-54667cd790dd">
Nov 30 10:49:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Nov 30 10:49:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:port uuid="fa7b73e3-b623-474f-a636-164d67d9029d">
Nov 30 10:49:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Nov 30 10:49:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:port uuid="7a9ded10-59fc-429b-a08c-cb8282d20238">
Nov 30 10:49:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 10:49:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:49:33 user nova-compute[75020]:         <nova:port uuid="e72d127f-f4ce-4595-9cb8-f30e6ebed2d7">
Nov 30 10:49:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 10:49:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:49:33 user nova-compute[75020]:       </nova:ports>
Nov 30 10:49:33 user nova-compute[75020]:     </nova:instance>
Nov 30 10:49:33 user nova-compute[75020]:   </metadata>
Nov 30 10:49:33 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:49:33 user nova-compute[75020]:     <system>
Nov 30 10:49:33 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:49:33 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:49:33 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:49:33 user nova-compute[75020]:       <entry name="serial">a9ad945a-9ce1-4d42-888c-18e660b9d67c</entry>
Nov 30 10:49:33 user nova-compute[75020]:       <entry name="uuid">a9ad945a-9ce1-4d42-888c-18e660b9d67c</entry>
Nov 30 10:49:33 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:49:33 user nova-compute[75020]:     </system>
Nov 30 10:49:33 user nova-compute[75020]:   </sysinfo>
Nov 30 10:49:33 user nova-compute[75020]:   <os>
Nov 30 10:49:33 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:49:33 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:49:33 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:49:33 user nova-compute[75020]:   </os>
Nov 30 10:49:33 user nova-compute[75020]:   <features>
Nov 30 10:49:33 user nova-compute[75020]:     <acpi/>
Nov 30 10:49:33 user nova-compute[75020]:     <apic/>
Nov 30 10:49:33 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:49:33 user nova-compute[75020]:   </features>
Nov 30 10:49:33 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:49:33 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:49:33 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:49:33 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:49:33 user nova-compute[75020]:   </clock>
Nov 30 10:49:33 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:49:33 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:49:33 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:49:33 user nova-compute[75020]:   </cpu>
Nov 30 10:49:33 user nova-compute[75020]:   <devices>
Nov 30 10:49:33 user nova-compute[75020]:     <disk type="file" device="cdrom">
Nov 30 10:49:33 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 10:49:33 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/a9ad945a-9ce1-4d42-888c-18e660b9d67c/disk.config"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="hda" bus="ide"/>
Nov 30 10:49:33 user nova-compute[75020]:     </disk>
Nov 30 10:49:33 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:49:33 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:49:33 user nova-compute[75020]:       <source dev="/dev/sdb"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <serial>c485241a-d3ce-4f5f-8e36-c5097afa4bb6</serial>
Nov 30 10:49:33 user nova-compute[75020]:     </disk>
Nov 30 10:49:33 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:49:33 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:49:33 user nova-compute[75020]:       <source dev="/dev/sdc"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <serial>eabfdc11-d002-41bc-b708-dbb60ba404be</serial>
Nov 30 10:49:33 user nova-compute[75020]:     </disk>
Nov 30 10:49:33 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:49:33 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:49:33 user nova-compute[75020]:       <source dev="/dev/sdd"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="vdc" bus="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <serial>363f5d5c-f690-4f66-b660-b5a25009605c</serial>
Nov 30 10:49:33 user nova-compute[75020]:     </disk>
Nov 30 10:49:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:49:33 user nova-compute[75020]:       <mac address="fa:16:3e:28:ab:b9"/>
Nov 30 10:49:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="tap6d05c95f-4b"/>
Nov 30 10:49:33 user nova-compute[75020]:     </interface>
Nov 30 10:49:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:49:33 user nova-compute[75020]:       <mac address="fa:16:3e:e3:78:ed"/>
Nov 30 10:49:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="tap15aee499-aa"/>
Nov 30 10:49:33 user nova-compute[75020]:     </interface>
Nov 30 10:49:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:49:33 user nova-compute[75020]:       <mac address="fa:16:3e:80:ff:22"/>
Nov 30 10:49:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="tapdb40c00e-b7"/>
Nov 30 10:49:33 user nova-compute[75020]:     </interface>
Nov 30 10:49:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:49:33 user nova-compute[75020]:       <mac address="fa:16:3e:03:b8:3f"/>
Nov 30 10:49:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="tap0345f742-a0"/>
Nov 30 10:49:33 user nova-compute[75020]:     </interface>
Nov 30 10:49:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:49:33 user nova-compute[75020]:       <mac address="fa:16:3e:e1:b7:de"/>
Nov 30 10:49:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="tapfa7b73e3-b6"/>
Nov 30 10:49:33 user nova-compute[75020]:     </interface>
Nov 30 10:49:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:49:33 user nova-compute[75020]:       <mac address="fa:16:3e:d8:bc:68"/>
Nov 30 10:49:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="tap7a9ded10-59"/>
Nov 30 10:49:33 user nova-compute[75020]:     </interface>
Nov 30 10:49:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:49:33 user nova-compute[75020]:       <mac address="fa:16:3e:47:6d:c8"/>
Nov 30 10:49:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:49:33 user nova-compute[75020]:       <target dev="tape72d127f-f4"/>
Nov 30 10:49:33 user nova-compute[75020]:     </interface>
Nov 30 10:49:33 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:49:33 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/a9ad945a-9ce1-4d42-888c-18e660b9d67c/console.log" append="off"/>
Nov 30 10:49:33 user nova-compute[75020]:     </serial>
Nov 30 10:49:33 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:49:33 user nova-compute[75020]:     <video>
Nov 30 10:49:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:49:33 user nova-compute[75020]:     </video>
Nov 30 10:49:33 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:49:33 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:49:33 user nova-compute[75020]:     </rng>
Nov 30 10:49:33 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:49:33 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:49:33 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:49:33 user nova-compute[75020]:     </memballoon>
Nov 30 10:49:33 user nova-compute[75020]:   </devices>
Nov 30 10:49:33 user nova-compute[75020]: </domain>
Nov 30 10:49:33 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d05c95f-4b7a-4397-a4a2-0940c89403d7,network=Network(137e30f8-3d94-4216-b53e-47ecc1bed798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05c95f-4b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d05c95f-4b7a-4397-a4a2-0940c89403d7,network=Network(137e30f8-3d94-4216-b53e-47ecc1bed798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05c95f-4b') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a049a7aa-dbb0-5b0c-a5fb-15a8458e3279', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d05c95f-4b, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d05c95f-4b, col_values=(('qos', UUID('2914a4d0-2ac2-42fb-ae57-695b7dc5853a')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d05c95f-4b, col_values=(('external_ids', {'iface-id': '6d05c95f-4b7a-4397-a4a2-0940c89403d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:ab:b9', 'vm-uuid': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: INFO os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d05c95f-4b7a-4397-a4a2-0940c89403d7,network=Network(137e30f8-3d94-4216-b53e-47ecc1bed798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05c95f-4b')
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:78:ed,bridge_name='br-int',has_traffic_filtering=True,id=15aee499-aa82-456a-832e-217fe9dd590e,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15aee499-aa') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:78:ed,bridge_name='br-int',has_traffic_filtering=True,id=15aee499-aa82-456a-832e-217fe9dd590e,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15aee499-aa') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eac66e84-1e5a-5985-90fc-a0f08d01a30e', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15aee499-aa, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15aee499-aa, col_values=(('qos', UUID('d8487040-c046-4ef0-834f-dd7bdd3fff3b')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15aee499-aa, col_values=(('external_ids', {'iface-id': '15aee499-aa82-456a-832e-217fe9dd590e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:78:ed', 'vm-uuid': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: INFO os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:78:ed,bridge_name='br-int',has_traffic_filtering=True,id=15aee499-aa82-456a-832e-217fe9dd590e,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15aee499-aa')
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:22,bridge_name='br-int',has_traffic_filtering=True,id=db40c00e-b7c2-42a8-9010-2bb48467c1fb,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb40c00e-b7') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:22,bridge_name='br-int',has_traffic_filtering=True,id=db40c00e-b7c2-42a8-9010-2bb48467c1fb,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb40c00e-b7') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45b30efa-5629-5d73-b166-1cdabcf48ff1', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb40c00e-b7, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb40c00e-b7, col_values=(('qos', UUID('419977d4-bc09-480f-9c45-e39f59b5d2ef')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb40c00e-b7, col_values=(('external_ids', {'iface-id': 'db40c00e-b7c2-42a8-9010-2bb48467c1fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:ff:22', 'vm-uuid': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: INFO os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:22,bridge_name='br-int',has_traffic_filtering=True,id=db40c00e-b7c2-42a8-9010-2bb48467c1fb,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb40c00e-b7')
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=0345f742-a081-4244-b874-54667cd790dd,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0345f742-a0') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=0345f742-a081-4244-b874-54667cd790dd,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0345f742-a0') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb04f374-d057-59c4-ad98-c97aeb7c8059', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0345f742-a0, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0345f742-a0, col_values=(('qos', UUID('4c8780eb-152f-4b81-9e5c-751ef346fe66')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0345f742-a0, col_values=(('external_ids', {'iface-id': '0345f742-a081-4244-b874-54667cd790dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:b8:3f', 'vm-uuid': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: INFO os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=0345f742-a081-4244-b874-54667cd790dd,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0345f742-a0')
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:de,bridge_name='br-int',has_traffic_filtering=True,id=fa7b73e3-b623-474f-a636-164d67d9029d,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b73e3-b6') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:de,bridge_name='br-int',has_traffic_filtering=True,id=fa7b73e3-b623-474f-a636-164d67d9029d,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b73e3-b6') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c597a5c7-72f1-52a6-8c14-b64f2444700c', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa7b73e3-b6, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa7b73e3-b6, col_values=(('qos', UUID('3dff66f9-61c1-462f-b69f-0539a90bfea0')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa7b73e3-b6, col_values=(('external_ids', {'iface-id': 'fa7b73e3-b623-474f-a636-164d67d9029d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:b7:de', 'vm-uuid': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: INFO os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:de,bridge_name='br-int',has_traffic_filtering=True,id=fa7b73e3-b623-474f-a636-164d67d9029d,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b73e3-b6')
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=7a9ded10-59fc-429b-a08c-cb8282d20238,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ded10-59') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=7a9ded10-59fc-429b-a08c-cb8282d20238,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ded10-59') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31a97c02-6018-5d5e-b341-b62f087f744e', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a9ded10-59, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a9ded10-59, col_values=(('qos', UUID('c2977883-3edb-450a-8af4-0a898600aff5')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a9ded10-59, col_values=(('external_ids', {'iface-id': '7a9ded10-59fc-429b-a08c-cb8282d20238', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:bc:68', 'vm-uuid': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: INFO os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=7a9ded10-59fc-429b-a08c-cb8282d20238,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ded10-59')
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6d:c8,bridge_name='br-int',has_traffic_filtering=True,id=e72d127f-f4ce-4595-9cb8-f30e6ebed2d7,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72d127f-f4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6d:c8,bridge_name='br-int',has_traffic_filtering=True,id=e72d127f-f4ce-4595-9cb8-f30e6ebed2d7,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72d127f-f4') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6512efa7-0b6f-5fcf-a3a5-e4b4ea64a477', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape72d127f-f4, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape72d127f-f4, col_values=(('qos', UUID('0936f1a7-25cd-45af-9007-0699340a8483')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape72d127f-f4, col_values=(('external_ids', {'iface-id': 'e72d127f-f4ce-4595-9cb8-f30e6ebed2d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:6d:c8', 'vm-uuid': 'a9ad945a-9ce1-4d42-888c-18e660b9d67c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:33 user nova-compute[75020]: INFO nova.compute.manager [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] instance snapshotting
Nov 30 10:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:33 user nova-compute[75020]: INFO os_vif [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6d:c8,bridge_name='br-int',has_traffic_filtering=True,id=e72d127f-f4ce-4595-9cb8-f30e6ebed2d7,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72d127f-f4')
Nov 30 10:49:33 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Beginning live snapshot process
Nov 30 10:49:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] No BDM found with device name hda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] No VIF found with MAC fa:16:3e:28:ab:b9, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] No VIF found with MAC fa:16:3e:e1:b7:de, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:49:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Using config drive
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json -f qcow2 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Creating config drive at /opt/stack/data/nova/instances/a9ad945a-9ce1-4d42-888c-18e660b9d67c/disk.config
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9ad945a-9ce1-4d42-888c-18e660b9d67c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4o_esq9v {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9ad945a-9ce1-4d42-888c-18e660b9d67c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4o_esq9v" returned: 0 in 0.051s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json -f qcow2 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeh9gzydp/e4983b5b452e4235a7464e0fc7954f8f.delta 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeh9gzydp/e4983b5b452e4235a7464e0fc7954f8f.delta 1073741824" returned: 0 in 0.045s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 10:49:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75020) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 30 10:49:34 user nova-compute[75020]: INFO nova.virt.libvirt.host [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] UEFI support detected
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:49:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Instance spawned successfully.
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-8bc52567-0b86-4383-8b9c-ff58fa4ce440 req-d2dfc04e-5d8e-4312-bd30-c4dcb67fd9f9 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received event network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8bc52567-0b86-4383-8b9c-ff58fa4ce440 req-d2dfc04e-5d8e-4312-bd30-c4dcb67fd9f9 service nova] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8bc52567-0b86-4383-8b9c-ff58fa4ce440 req-d2dfc04e-5d8e-4312-bd30-c4dcb67fd9f9 service nova] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8bc52567-0b86-4383-8b9c-ff58fa4ce440 req-d2dfc04e-5d8e-4312-bd30-c4dcb67fd9f9 service nova] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-8bc52567-0b86-4383-8b9c-ff58fa4ce440 req-d2dfc04e-5d8e-4312-bd30-c4dcb67fd9f9 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] No waiting events found dispatching network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:35 user nova-compute[75020]: WARNING nova.compute.manager [req-8bc52567-0b86-4383-8b9c-ff58fa4ce440 req-d2dfc04e-5d8e-4312-bd30-c4dcb67fd9f9 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received unexpected event network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 for instance with vm_state building and task_state spawning.
Nov 30 10:49:35 user nova-compute[75020]: INFO nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:49:35 user nova-compute[75020]: INFO nova.compute.manager [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Took 6.44 seconds to build instance.
Nov 30 10:49:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1be0489b-2c3e-43de-b721-b82260ea6c47 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.544s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] COPY block job progress, current cursor: 75825152 final cursor: 75825152 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:49:36 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 10:49:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeh9gzydp/e4983b5b452e4235a7464e0fc7954f8f.delta /opt/stack/data/nova/instances/snapshots/tmpeh9gzydp/e4983b5b452e4235a7464e0fc7954f8f {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-979fc342-2734-4d12-8ba3-3e0843443601 req-764f9ea3-34b1-4366-b616-d1716d8f6cdf service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-979fc342-2734-4d12-8ba3-3e0843443601 req-764f9ea3-34b1-4366-b616-d1716d8f6cdf service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-979fc342-2734-4d12-8ba3-3e0843443601 req-764f9ea3-34b1-4366-b616-d1716d8f6cdf service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-979fc342-2734-4d12-8ba3-3e0843443601 req-764f9ea3-34b1-4366-b616-d1716d8f6cdf service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-979fc342-2734-4d12-8ba3-3e0843443601 req-764f9ea3-34b1-4366-b616-d1716d8f6cdf service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:36 user nova-compute[75020]: WARNING nova.compute.manager [req-979fc342-2734-4d12-8ba3-3e0843443601 req-764f9ea3-34b1-4366-b616-d1716d8f6cdf service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 for instance with vm_state building and task_state spawning.
Nov 30 10:49:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-3d0230d0-3fb5-4f93-9dfa-a92cdbbe2943 req-5baf59ee-7ba6-46e5-89b4-2191c79df705 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3d0230d0-3fb5-4f93-9dfa-a92cdbbe2943 req-5baf59ee-7ba6-46e5-89b4-2191c79df705 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3d0230d0-3fb5-4f93-9dfa-a92cdbbe2943 req-5baf59ee-7ba6-46e5-89b4-2191c79df705 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3d0230d0-3fb5-4f93-9dfa-a92cdbbe2943 req-5baf59ee-7ba6-46e5-89b4-2191c79df705 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-3d0230d0-3fb5-4f93-9dfa-a92cdbbe2943 req-5baf59ee-7ba6-46e5-89b4-2191c79df705 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:37 user nova-compute[75020]: WARNING nova.compute.manager [req-3d0230d0-3fb5-4f93-9dfa-a92cdbbe2943 req-5baf59ee-7ba6-46e5-89b4-2191c79df705 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e for instance with vm_state building and task_state spawning.
Nov 30 10:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeh9gzydp/e4983b5b452e4235a7464e0fc7954f8f.delta /opt/stack/data/nova/instances/snapshots/tmpeh9gzydp/e4983b5b452e4235a7464e0fc7954f8f" returned: 0 in 0.793s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Snapshot extracted, beginning image upload
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-d59c524b-d35f-41f0-a048-81416d8ab9c7 req-1920939f-e493-44f1-97fd-c537d2555a4d service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d59c524b-d35f-41f0-a048-81416d8ab9c7 req-1920939f-e493-44f1-97fd-c537d2555a4d service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d59c524b-d35f-41f0-a048-81416d8ab9c7 req-1920939f-e493-44f1-97fd-c537d2555a4d service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d59c524b-d35f-41f0-a048-81416d8ab9c7 req-1920939f-e493-44f1-97fd-c537d2555a4d service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-d59c524b-d35f-41f0-a048-81416d8ab9c7 req-1920939f-e493-44f1-97fd-c537d2555a4d service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:38 user nova-compute[75020]: WARNING nova.compute.manager [req-d59c524b-d35f-41f0-a048-81416d8ab9c7 req-1920939f-e493-44f1-97fd-c537d2555a4d service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 for instance with vm_state building and task_state spawning.
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:38 user nova-compute[75020]: WARNING nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 for instance with vm_state building and task_state spawning.
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:38 user nova-compute[75020]: WARNING nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb for instance with vm_state building and task_state spawning.
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:38 user nova-compute[75020]: WARNING nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb for instance with vm_state building and task_state spawning.
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:38 user nova-compute[75020]: WARNING nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd for instance with vm_state building and task_state spawning.
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:38 user nova-compute[75020]: WARNING nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd for instance with vm_state building and task_state spawning.
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:38 user nova-compute[75020]: WARNING nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d for instance with vm_state building and task_state spawning.
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:38 user nova-compute[75020]: WARNING nova.compute.manager [req-825279e9-ba84-4568-af00-d79eea219e38 req-fe72a882-1349-4306-bae0-71524a6a43ac service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d for instance with vm_state building and task_state spawning.
Nov 30 10:49:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.019s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lazy-loading 'flavor' on Instance uuid 134d8045-4c59-429d-9c01-6c451f0fa58b {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-changed-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Refreshing instance network info cache due to event network-changed-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Acquiring lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Acquired lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Refreshing network info cache for port d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.260s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:40 user nova-compute[75020]: INFO nova.compute.manager [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Attaching volume 4d0a59bf-2890-4e2b-8583-a9d7efb36e1f to /dev/vdb
Nov 30 10:49:40 user nova-compute[75020]: DEBUG os_brick.utils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c377ef6-4b81-4db9-9eec-a604d47cdee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7675308a-e045-49ae-86df-b53ea037a995]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6be6c7-bd97-48e0-a7b1-9c2ec5d3a01b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d47fc-408a-49c5-b887-bd307866404e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:40 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c54d0c1-0a71-4b17-a5a5-4f3c308adbaa]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG os_brick.utils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] <== get_connector_properties: return (364ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Updating existing volume attachment record: e6d23700-5551-4c26-a67e-6db65feadd4f {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:49:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-4febd8b6-753c-4444-9e69-b3a0562dbc26 req-f0300b3f-ad3c-4a35-8b45-de8082cced84 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4febd8b6-753c-4444-9e69-b3a0562dbc26 req-f0300b3f-ad3c-4a35-8b45-de8082cced84 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4febd8b6-753c-4444-9e69-b3a0562dbc26 req-f0300b3f-ad3c-4a35-8b45-de8082cced84 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4febd8b6-753c-4444-9e69-b3a0562dbc26 req-f0300b3f-ad3c-4a35-8b45-de8082cced84 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-4febd8b6-753c-4444-9e69-b3a0562dbc26 req-f0300b3f-ad3c-4a35-8b45-de8082cced84 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:41 user nova-compute[75020]: WARNING nova.compute.manager [req-4febd8b6-753c-4444-9e69-b3a0562dbc26 req-f0300b3f-ad3c-4a35-8b45-de8082cced84 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 for instance with vm_state building and task_state spawning.
Nov 30 10:49:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.462s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Snapshot image upload complete
Nov 30 10:49:42 user nova-compute[75020]: INFO nova.compute.manager [None req-4290332b-b436-45a8-bcfd-c8e56c5e645e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Took 8.22 seconds to snapshot the instance on the hypervisor.
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.network.neutron [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updated VIF entry in instance network info cache for port d3370635-c4d4-4dc7-8a3c-a3dd2756dff0. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.network.neutron [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating instance_info_cache with network_info: [{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Releasing lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:42 user nova-compute[75020]: WARNING nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e for instance with vm_state building and task_state spawning.
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:42 user nova-compute[75020]: WARNING nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 for instance with vm_state building and task_state spawning.
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:42 user nova-compute[75020]: WARNING nova.compute.manager [req-6c71f82c-e6f0-43da-a4d8-98e65b8cc209 req-99993173-cda9-43b5-a860-31492349b2da service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 for instance with vm_state building and task_state spawning.
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:49:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance spawned successfully.
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:42 user nova-compute[75020]: INFO nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Took 13.66 seconds to spawn the instance on the hypervisor.
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:42 user nova-compute[75020]: INFO nova.compute.manager [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Took 44.05 seconds to build instance.
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b32ac42-1180-4a81-ad2c-a8bdb25e1fd7 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.197s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:43 user nova-compute[75020]: INFO nova.compute.manager [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Attaching volume c0e9c986-bdff-4207-be17-4e996343bee5 to /dev/vdb
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-38381562-afe5-48ae-840c-61f0b8e0b807 req-93be59e8-1414-489f-a074-a497f9473284 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-changed-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-38381562-afe5-48ae-840c-61f0b8e0b807 req-93be59e8-1414-489f-a074-a497f9473284 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Refreshing instance network info cache due to event network-changed-a3626203-1d0f-4d96-bf21-796358c11fd2. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38381562-afe5-48ae-840c-61f0b8e0b807 req-93be59e8-1414-489f-a074-a497f9473284 service nova] Acquiring lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38381562-afe5-48ae-840c-61f0b8e0b807 req-93be59e8-1414-489f-a074-a497f9473284 service nova] Acquired lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-38381562-afe5-48ae-840c-61f0b8e0b807 req-93be59e8-1414-489f-a074-a497f9473284 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Refreshing network info cache for port a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG os_brick.utils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fa3fd9-1a08-4875-ad48-6108f25a419d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e746762-bb54-444b-bae6-c26e428a1b8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[08657310-c8f9-47d3-a0fe-ef23219fccdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e4cfbc-4eec-479f-9b44-fa5dc09827fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-62a5d22c-5d01-43a6-9de6-8c2f9b7a6046 req-99d77962-91b6-4d09-a8f4-e354f7398eac service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-changed-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-62a5d22c-5d01-43a6-9de6-8c2f9b7a6046 req-99d77962-91b6-4d09-a8f4-e354f7398eac service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Refreshing instance network info cache due to event network-changed-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-62a5d22c-5d01-43a6-9de6-8c2f9b7a6046 req-99d77962-91b6-4d09-a8f4-e354f7398eac service nova] Acquiring lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-62a5d22c-5d01-43a6-9de6-8c2f9b7a6046 req-99d77962-91b6-4d09-a8f4-e354f7398eac service nova] Acquired lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-62a5d22c-5d01-43a6-9de6-8c2f9b7a6046 req-99d77962-91b6-4d09-a8f4-e354f7398eac service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Refreshing network info cache for port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:43 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fd655a-7ef2-4f5b-9685-dbbcf51ec97b]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG os_brick.utils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating existing volume attachment record: b0439567-412b-4fec-bcbb-f418717c1a88 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-38381562-afe5-48ae-840c-61f0b8e0b807 req-93be59e8-1414-489f-a074-a497f9473284 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updated VIF entry in instance network info cache for port a3626203-1d0f-4d96-bf21-796358c11fd2. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-38381562-afe5-48ae-840c-61f0b8e0b807 req-93be59e8-1414-489f-a074-a497f9473284 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updating instance_info_cache with network_info: [{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38381562-afe5-48ae-840c-61f0b8e0b807 req-93be59e8-1414-489f-a074-a497f9473284 service nova] Releasing lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG nova.network.neutron [req-62a5d22c-5d01-43a6-9de6-8c2f9b7a6046 req-99d77962-91b6-4d09-a8f4-e354f7398eac service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updated VIF entry in instance network info cache for port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG nova.network.neutron [req-62a5d22c-5d01-43a6-9de6-8c2f9b7a6046 req-99d77962-91b6-4d09-a8f4-e354f7398eac service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating instance_info_cache with network_info: [{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-62a5d22c-5d01-43a6-9de6-8c2f9b7a6046 req-99d77962-91b6-4d09-a8f4-e354f7398eac service nova] Releasing lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.628s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:46 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:49:46 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=6888MB free_disk=25.544010162353516GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 134d8045-4c59-429d-9c01-6c451f0fa58b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a709433f-c094-4726-8498-c508e14f9d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 88815763-252f-4506-aa0c-5524e8b96e08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77a73463-ea12-43c3-83a4-803f4a535010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77f4c5de-b6dd-486f-b121-47a08de231a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9ad945a-9ce1-4d42-888c-18e660b9d67c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:49:46 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:47 user nova-compute[75020]: INFO nova.compute.manager [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Shelving
Nov 30 10:49:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-5a4443ef-6437-4d4e-a5ec-ff5aa0362456 req-b10d87c5-c330-4b31-b9f9-3e922ece7865 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-unplugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5a4443ef-6437-4d4e-a5ec-ff5aa0362456 req-b10d87c5-c330-4b31-b9f9-3e922ece7865 service nova] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5a4443ef-6437-4d4e-a5ec-ff5aa0362456 req-b10d87c5-c330-4b31-b9f9-3e922ece7865 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5a4443ef-6437-4d4e-a5ec-ff5aa0362456 req-b10d87c5-c330-4b31-b9f9-3e922ece7865 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-5a4443ef-6437-4d4e-a5ec-ff5aa0362456 req-b10d87c5-c330-4b31-b9f9-3e922ece7865 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] No waiting events found dispatching network-vif-unplugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:47 user nova-compute[75020]: WARNING nova.compute.manager [req-5a4443ef-6437-4d4e-a5ec-ff5aa0362456 req-b10d87c5-c330-4b31-b9f9-3e922ece7865 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received unexpected event network-vif-unplugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f for instance with vm_state active and task_state shelving.
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:49:48 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance destroyed successfully.
Nov 30 10:49:48 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Beginning cold snapshot process
Nov 30 10:49:48 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk /opt/stack/data/nova/instances/snapshots/tmpy2jktpz4/c4589494c0bb4ee49edb4283e49f1077 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating instance_info_cache with network_info: [{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:49:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk /opt/stack/data/nova/instances/snapshots/tmpy2jktpz4/c4589494c0bb4ee49edb4283e49f1077" returned: 0 in 0.706s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Snapshot extracted, beginning image upload
Nov 30 10:49:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-e356d3c5-d298-4b3a-83c6-dd66a99a8ee9 req-8029bc1c-73f2-4a3b-ba07-de67953795a5 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e356d3c5-d298-4b3a-83c6-dd66a99a8ee9 req-8029bc1c-73f2-4a3b-ba07-de67953795a5 service nova] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e356d3c5-d298-4b3a-83c6-dd66a99a8ee9 req-8029bc1c-73f2-4a3b-ba07-de67953795a5 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e356d3c5-d298-4b3a-83c6-dd66a99a8ee9 req-8029bc1c-73f2-4a3b-ba07-de67953795a5 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-e356d3c5-d298-4b3a-83c6-dd66a99a8ee9 req-8029bc1c-73f2-4a3b-ba07-de67953795a5 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] No waiting events found dispatching network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:50 user nova-compute[75020]: WARNING nova.compute.manager [req-e356d3c5-d298-4b3a-83c6-dd66a99a8ee9 req-8029bc1c-73f2-4a3b-ba07-de67953795a5 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received unexpected event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 10:49:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvyQgJse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:52 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:52 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:52 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac909a5-dd94-4f5d-83fe-12194458680d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:49:52 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[433f98a8-6e89-461f-8b8f-dd7a57f1a5b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f] added
Nov 30 10:49:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a0859-3698-4e30-85c5-1770d618420c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4566a-4c61-453e-a59a-9ea99328b0a4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fvyQgJse {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fvyQgJse" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f226e-943c-4093-8e93-0bcb587d06c7]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fvyQgJse'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce679fac-8d51-4784-b6aa-e0de860d13a4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c400db-fae5-4d34-aaed-1e80a696f369]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa62e61-2136-4cff-9b67-dd67a369f050]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f, portal: 172.16.0.220,3260]
Nov 30 10:49:52 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f, portal: 172.16.0.220,3260] successful.
Nov 30 10:49:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d39abd-86d2-4698-a6b2-cf8f3d591476]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Snapshot image upload complete
Nov 30 10:49:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e4879-de5e-48ac-b9f2-e541a7105148]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)
Nov 30 10:49:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:52 user nova-compute[75020]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)
Nov 30 10:49:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.046s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[63365b8c-b8c4-4307-aac6-6531429f09ea]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvyQgJse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:49:52 user nova-compute[75020]: INFO nova.compute.manager [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Shelve offloading
Nov 30 10:49:52 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance destroyed successfully.
Nov 30 10:49:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquired lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:49:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating instance_info_cache with network_info: [{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Releasing lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '26131343536333330', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131343536333330', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lazy-loading 'flavor' on Instance uuid 134d8045-4c59-429d-9c01-6c451f0fa58b {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:49:53 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:49:53 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:49:53 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:49:53 user nova-compute[75020]:   <serial>4d0a59bf-2890-4e2b-8583-a9d7efb36e1f</serial>
Nov 30 10:49:53 user nova-compute[75020]: </disk>
Nov 30 10:49:53 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:49:53 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance destroyed successfully.
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'resources' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1075430230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1075430230',id=5,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9U8mBMZ0h7K8lJV9407mFRx1E9E6BfrnfMq1FhxGbl9GDd/B4bNbFXcIESnDYN3W4Elef2TabyP8ZrlhZA/5ujoP1+jBUf/HVCektXsUP2ThO2mH0G7f7uCCHkrsaeA==',key_name='tempest-keypair-1856789779',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-kuebsqbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member',shelved_at='2023-11-30T10:49:52.545824',shelved_host='user',shelved_image_id='9c784e77-a3c9-47fd-9c2c-69e71413cd08'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=a709433f-c094-4726-8498-c508e14f9d54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_vif [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-d0e15671-1d77-4375-963b-25f6196f5058 req-1aba13a7-872d-4a55-b968-1c2a9d6405f2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-changed-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-d0e15671-1d77-4375-963b-25f6196f5058 req-1aba13a7-872d-4a55-b968-1c2a9d6405f2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Refreshing instance network info cache due to event network-changed-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0e15671-1d77-4375-963b-25f6196f5058 req-1aba13a7-872d-4a55-b968-1c2a9d6405f2 service nova] Acquiring lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0e15671-1d77-4375-963b-25f6196f5058 req-1aba13a7-872d-4a55-b968-1c2a9d6405f2 service nova] Acquired lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.network.neutron [req-d0e15671-1d77-4375-963b-25f6196f5058 req-1aba13a7-872d-4a55-b968-1c2a9d6405f2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Refreshing network info cache for port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b71bc40-4d, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b67f981-32ac-40ed-ac42-59e148c6cf52) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHZvTnaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:53 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:53 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:53 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:49:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:53 user nova-compute[75020]: INFO os_vif [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d')
Nov 30 10:49:53 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Deleting instance files /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54_del
Nov 30 10:49:53 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Deletion of /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54_del complete
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58fb614-66fc-4a2d-9a14-149b9d7f2336]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:49:53 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[46859d3e-609e-4fe3-8b07-f1377d6bb3df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5] added
Nov 30 10:49:53 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[96690be1-4eac-4f74-83ce-7c2cc6b0c96d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa87e0-ce83-4d8d-aaa7-3fd91a701ac2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHZvTnaV {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Deleted allocations for instance a709433f-c094-4726-8498-c508e14f9d54
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHZvTnaV" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d1d4a-783c-454d-8d7e-b6ae4d25fea6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHZvTnaV'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc758283-1c9f-4823-8e7a-c759985c4cd4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'numa_topology' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[059dfa00-bd46-4501-8b84-03cd1bd786ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)
Nov 30 10:49:54 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)
Nov 30 10:49:54 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.objects.base [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<a709433f-c094-4726-8498-c508e14f9d54> lazy-loaded attributes: resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fdedec-3e67-415f-8240-746996b186ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260]
Nov 30 10:49:54 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260] successful.
Nov 30 10:49:54 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] No VIF found with MAC fa:16:3e:fa:81:a5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7401e77f-9f61-4675-95d2-36cff9f238f0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-14fd75b1-9373-46f3-9c87-f08ca74dbeaf req-507eb7a5-6b15-461b-910a-7a65cb66450f service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received event network-changed-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-14fd75b1-9373-46f3-9c87-f08ca74dbeaf req-507eb7a5-6b15-461b-910a-7a65cb66450f service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Refreshing instance network info cache due to event network-changed-159fa17a-1663-4e44-bd28-074acd3bf84f. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14fd75b1-9373-46f3-9c87-f08ca74dbeaf req-507eb7a5-6b15-461b-910a-7a65cb66450f service nova] Acquiring lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14fd75b1-9373-46f3-9c87-f08ca74dbeaf req-507eb7a5-6b15-461b-910a-7a65cb66450f service nova] Acquired lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-14fd75b1-9373-46f3-9c87-f08ca74dbeaf req-507eb7a5-6b15-461b-910a-7a65cb66450f service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Refreshing network info cache for port 159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b363e473-52ad-41c8-9ff1-68dde6ee8b04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:49:54 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)
Nov 30 10:49:54 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:49:54 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5586c5c1-a876-4b70-b98f-39ea965725b5]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHZvTnaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a0aef975-9086-456b-a9af-1070a871485d tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.222s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-d0e15671-1d77-4375-963b-25f6196f5058 req-1aba13a7-872d-4a55-b968-1c2a9d6405f2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updated VIF entry in instance network info cache for port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-d0e15671-1d77-4375-963b-25f6196f5058 req-1aba13a7-872d-4a55-b968-1c2a9d6405f2 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating instance_info_cache with network_info: [{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0e15671-1d77-4375-963b-25f6196f5058 req-1aba13a7-872d-4a55-b968-1c2a9d6405f2 service nova] Releasing lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdfed6fa-0c9c-41c3-927c-95a9369de54e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.132s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-14fd75b1-9373-46f3-9c87-f08ca74dbeaf req-507eb7a5-6b15-461b-910a-7a65cb66450f service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updated VIF entry in instance network info cache for port 159fa17a-1663-4e44-bd28-074acd3bf84f. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-14fd75b1-9373-46f3-9c87-f08ca74dbeaf req-507eb7a5-6b15-461b-910a-7a65cb66450f service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updating instance_info_cache with network_info: [{"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14fd75b1-9373-46f3-9c87-f08ca74dbeaf req-507eb7a5-6b15-461b-910a-7a65cb66450f service nova] Releasing lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:54 user nova-compute[75020]: INFO nova.compute.manager [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Terminating instance
Nov 30 10:49:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23339346235393337', 'path': '/dev/sdf'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339346235393337', 'path': '/dev/sdf'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:49:55 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:49:55 user nova-compute[75020]:   <source dev="/dev/sdf"/>
Nov 30 10:49:55 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:49:55 user nova-compute[75020]:   <serial>c0e9c986-bdff-4207-be17-4e996343bee5</serial>
Nov 30 10:49:55 user nova-compute[75020]: </disk>
Nov 30 10:49:55 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received event network-vif-unplugged-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] No waiting events found dispatching network-vif-unplugged-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received event network-vif-unplugged-a4a4832e-d076-40a2-b8f0-c844402dd1de for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received event network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] Acquiring lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] No waiting events found dispatching network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:55 user nova-compute[75020]: WARNING nova.compute.manager [req-fc1799cc-f200-4772-88ea-0b7dad56b0c1 req-82f92c2d-3db5-4e78-8da4-c101eefc5405 service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received unexpected event network-vif-plugged-a4a4832e-d076-40a2-b8f0-c844402dd1de for instance with vm_state active and task_state deleting.
Nov 30 10:49:56 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Instance destroyed successfully.
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lazy-loading 'resources' on Instance uuid 134d8045-4c59-429d-9c01-6c451f0fa58b {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-449197611',display_name='tempest-DeleteServersTestJSON-server-449197611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-449197611',id=3,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d45560c8a2642bd8c079763d52047e6',ramdisk_id='',reservation_id='r-i8e78a0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1785683651',owner_user_name='tempest-DeleteServersTestJSON-1785683651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:04Z,user_data=None,user_id='a0beedde307a4b06abb0dd9141d208e6',uuid=134d8045-4c59-429d-9c01-6c451f0fa58b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Converting VIF {"id": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "address": "fa:16:3e:fa:81:a5", "network": {"id": "df2e9d30-a745-4863-8a91-97f1a454aae8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-753966947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d45560c8a2642bd8c079763d52047e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a4832e-d0", "ovs_interfaceid": "a4a4832e-d076-40a2-b8f0-c844402dd1de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:81:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4a4832e-d076-40a2-b8f0-c844402dd1de,network=Network(df2e9d30-a745-4863-8a91-97f1a454aae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a4832e-d0') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_vif [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:81:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4a4832e-d076-40a2-b8f0-c844402dd1de,network=Network(df2e9d30-a745-4863-8a91-97f1a454aae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a4832e-d0') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4a4832e-d0, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=745da233-ad83-4d8e-a21f-975ade9f42b6) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:56 user nova-compute[75020]: INFO os_vif [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:81:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4a4832e-d076-40a2-b8f0-c844402dd1de,network=Network(df2e9d30-a745-4863-8a91-97f1a454aae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a4832e-d0')
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvyQgJse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:56 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f6bd5-6d59-4436-991a-2695bcad69b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:49:56 user nova-compute[75020]: No targets found.
Nov 30 10:49:56 user nova-compute[75020]: iSNS:
Nov 30 10:49:56 user nova-compute[75020]: No targets found.
Nov 30 10:49:56 user nova-compute[75020]: STATIC:
Nov 30 10:49:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c
Nov 30 10:49:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:49:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:49:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:49:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:49:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:49:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be
Nov 30 10:49:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:49:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:49:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6
Nov 30 10:49:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:49:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:49:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f
Nov 30 10:49:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:49:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:49:56 user nova-compute[75020]: FIRMWARE:
Nov 30 10:49:56 user nova-compute[75020]: No targets found.
Nov 30 10:49:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:49:56 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:49:56 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No VIF found with MAC fa:16:3e:54:c0:d7, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0437e1-d4c5-49b1-b3ad-0edc05a99448]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf0e29-9c82-485c-8e29-0e0e878ceccd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:56 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:56 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:56 user nova-compute[75020]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)
Nov 30 10:49:56 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:49:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:49:56 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:49:56 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:49:56 user nova-compute[75020]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f (non-flash)
Nov 30 10:49:56 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:49:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada864ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd683309-f275-4df2-a2c4-b37c729d1eae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d4aac0-27ab-4c60-95cc-8d905df21e66]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4977bc36-4515-46d6-8b69-5975197998ab]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ec3194b0-ba80-4453-9062-83ec4a17383e tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.211s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae32863-3b55-4256-9f2c-2b2437671e06]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[83513c2a-3610-4532-8721-43ede1e5a1ce]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67f30c6-ba17-4d8a-ab06-e818090764f2]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f, portal: 172.16.0.220,3260]
Nov 30 10:49:56 user nova-compute[75020]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f, portal: 172.16.0.220,3260] successful.
Nov 30 10:49:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0a59bf-2890-4e2b-8583-a9d7efb36e1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28ae862-bb86-477f-ba64-d46d968dba04]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] <== disconnect_volume: return (360ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:49:56 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Deleting instance files /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b_del
Nov 30 10:49:56 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Deletion of /opt/stack/data/nova/instances/134d8045-4c59-429d-9c01-6c451f0fa58b_del complete
Nov 30 10:49:56 user nova-compute[75020]: INFO nova.compute.manager [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 30 10:49:56 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:49:56 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lazy-loading 'flavor' on Instance uuid 88815763-252f-4506-aa0c-5524e8b96e08 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:57 user nova-compute[75020]: INFO nova.compute.manager [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Attaching volume 2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 to /dev/vdb
Nov 30 10:49:57 user nova-compute[75020]: DEBUG os_brick.utils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52b1dbc-ba25-47a5-a7ac-fb8a666e46bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[463ec1ba-b19c-4ecd-9bfd-9edb0dc5b63d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba6fc15-9a19-473b-bc9a-319a0619cb1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[719e50a3-af97-442f-b86a-1419cafa8bb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-86f60425-2874-4552-8bdb-ec843791f4a8 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-86f60425-2874-4552-8bdb-ec843791f4a8 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-86f60425-2874-4552-8bdb-ec843791f4a8 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-86f60425-2874-4552-8bdb-ec843791f4a8 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75020) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.objects.instance [None req-86f60425-2874-4552-8bdb-ec843791f4a8 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:49:57 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a0011b-9629-4dcf-9471-c17ef8daa037]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG os_brick.utils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updating existing volume attachment record: ddeec3f4-1926-4284-b076-aa0acd4bb498 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-25450fb7-ade4-434c-a806-8dbdc9d9c288 req-f0027019-a8f9-4cdc-9eea-c19f2d78200a service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Received event network-vif-deleted-a4a4832e-d076-40a2-b8f0-c844402dd1de {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:57 user nova-compute[75020]: INFO nova.compute.manager [req-25450fb7-ade4-434c-a806-8dbdc9d9c288 req-f0027019-a8f9-4cdc-9eea-c19f2d78200a service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Neutron deleted interface a4a4832e-d076-40a2-b8f0-c844402dd1de; detaching it from the instance and deleting it from the info cache
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.network.neutron [req-25450fb7-ade4-434c-a806-8dbdc9d9c288 req-f0027019-a8f9-4cdc-9eea-c19f2d78200a service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:49:57 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Took 1.01 seconds to deallocate network for instance.
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-25450fb7-ade4-434c-a806-8dbdc9d9c288 req-f0027019-a8f9-4cdc-9eea-c19f2d78200a service nova] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Detach interface failed, port_id=a4a4832e-d076-40a2-b8f0-c844402dd1de, reason: Instance 134d8045-4c59-429d-9c01-6c451f0fa58b could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-acb639e7-98b2-4451-b4e9-97f25b49075e req-1e3a249f-d8b4-43e1-a65e-09b916ccd5a5 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-acb639e7-98b2-4451-b4e9-97f25b49075e req-1e3a249f-d8b4-43e1-a65e-09b916ccd5a5 service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-acb639e7-98b2-4451-b4e9-97f25b49075e req-1e3a249f-d8b4-43e1-a65e-09b916ccd5a5 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-acb639e7-98b2-4451-b4e9-97f25b49075e req-1e3a249f-d8b4-43e1-a65e-09b916ccd5a5 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-acb639e7-98b2-4451-b4e9-97f25b49075e req-1e3a249f-d8b4-43e1-a65e-09b916ccd5a5 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:57 user nova-compute[75020]: WARNING nova.compute.manager [req-acb639e7-98b2-4451-b4e9-97f25b49075e req-1e3a249f-d8b4-43e1-a65e-09b916ccd5a5 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state active and task_state powering-off.
Nov 30 10:49:58 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance destroyed successfully.
Nov 30 10:49:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-86f60425-2874-4552-8bdb-ec843791f4a8 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:49:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-86f60425-2874-4552-8bdb-ec843791f4a8 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.955s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:58 user nova-compute[75020]: INFO nova.compute.manager [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] [instance: 134d8045-4c59-429d-9c01-6c451f0fa58b] Took 0.89 seconds to detach 1 volumes for instance.
Nov 30 10:49:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:58 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:49:58 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:49:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:58 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Deleted allocations for instance 134d8045-4c59-429d-9c01-6c451f0fa58b
Nov 30 10:49:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3e761afc-56e5-40ac-b071-286f2c12879b tempest-DeleteServersTestJSON-1785683651 tempest-DeleteServersTestJSON-1785683651-project-member] Lock "134d8045-4c59-429d-9c01-6c451f0fa58b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.042s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-5ebe982a-4c1a-46cf-b7ee-d714d22cff67 req-4adafb19-22b8-4159-baee-0478791bef26 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:49:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ebe982a-4c1a-46cf-b7ee-d714d22cff67 req-4adafb19-22b8-4159-baee-0478791bef26 service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:49:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ebe982a-4c1a-46cf-b7ee-d714d22cff67 req-4adafb19-22b8-4159-baee-0478791bef26 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:49:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ebe982a-4c1a-46cf-b7ee-d714d22cff67 req-4adafb19-22b8-4159-baee-0478791bef26 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:49:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-5ebe982a-4c1a-46cf-b7ee-d714d22cff67 req-4adafb19-22b8-4159-baee-0478791bef26 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:49:59 user nova-compute[75020]: WARNING nova.compute.manager [req-5ebe982a-4c1a-46cf-b7ee-d714d22cff67 req-4adafb19-22b8-4159-baee-0478791bef26 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state stopped and task_state None.
Nov 30 10:50:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG nova.objects.instance [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lazy-loading 'flavor' on Instance uuid 77a73463-ea12-43c3-83a4-803f4a535010 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:01 user nova-compute[75020]: INFO nova.compute.manager [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Attaching volume 28ce2c33-7e7a-40ae-8565-4092f5421a44 to /dev/vdb
Nov 30 10:50:01 user nova-compute[75020]: DEBUG os_brick.utils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[649ce0be-ff59-4ddb-acb8-6857383130e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae2fdf8-4469-4fcb-99a4-e3ab686af799]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bdb514-ebbd-4012-9172-7fccebda23c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e492a8b2-0293-4f88-aa29-be758c0f21f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:01 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02dfc4c-0cb4-4bdf-b74b-c7deef2fe9ac]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG os_brick.utils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updating existing volume attachment record: ff82cb93-0b8c-44fe-b07b-a948e0fb2d60 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c248a1d-8880-4e6d-a23e-f856c50fa638 req-255b7392-4f44-4357-95c1-69b5110a4ee4 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received event network-changed-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c248a1d-8880-4e6d-a23e-f856c50fa638 req-255b7392-4f44-4357-95c1-69b5110a4ee4 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Refreshing instance network info cache due to event network-changed-a07ca90e-cde9-4f99-891b-3f1a28e95650. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c248a1d-8880-4e6d-a23e-f856c50fa638 req-255b7392-4f44-4357-95c1-69b5110a4ee4 service nova] Acquiring lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c248a1d-8880-4e6d-a23e-f856c50fa638 req-255b7392-4f44-4357-95c1-69b5110a4ee4 service nova] Acquired lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:01 user nova-compute[75020]: DEBUG nova.network.neutron [req-6c248a1d-8880-4e6d-a23e-f856c50fa638 req-255b7392-4f44-4357-95c1-69b5110a4ee4 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Refreshing network info cache for port a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:50:02 user nova-compute[75020]: DEBUG nova.network.neutron [req-6c248a1d-8880-4e6d-a23e-f856c50fa638 req-255b7392-4f44-4357-95c1-69b5110a4ee4 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updated VIF entry in instance network info cache for port a07ca90e-cde9-4f99-891b-3f1a28e95650. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:50:02 user nova-compute[75020]: DEBUG nova.network.neutron [req-6c248a1d-8880-4e6d-a23e-f856c50fa638 req-255b7392-4f44-4357-95c1-69b5110a4ee4 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updating instance_info_cache with network_info: [{"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c248a1d-8880-4e6d-a23e-f856c50fa638 req-255b7392-4f44-4357-95c1-69b5110a4ee4 service nova] Releasing lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-cb92ee8c-af0b-4c97-bda3-72d9e86f4852 req-7ebcfc03-0d58-4485-a6d6-ce23e2536be3 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received event network-changed-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-cb92ee8c-af0b-4c97-bda3-72d9e86f4852 req-7ebcfc03-0d58-4485-a6d6-ce23e2536be3 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Refreshing instance network info cache due to event network-changed-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:50:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb92ee8c-af0b-4c97-bda3-72d9e86f4852 req-7ebcfc03-0d58-4485-a6d6-ce23e2536be3 service nova] Acquiring lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb92ee8c-af0b-4c97-bda3-72d9e86f4852 req-7ebcfc03-0d58-4485-a6d6-ce23e2536be3 service nova] Acquired lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-cb92ee8c-af0b-4c97-bda3-72d9e86f4852 req-7ebcfc03-0d58-4485-a6d6-ce23e2536be3 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Refreshing network info cache for port 4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:50:04 user nova-compute[75020]: DEBUG nova.network.neutron [req-cb92ee8c-af0b-4c97-bda3-72d9e86f4852 req-7ebcfc03-0d58-4485-a6d6-ce23e2536be3 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Updated VIF entry in instance network info cache for port 4ddd1a8f-43f5-4086-8c5f-8bb79c31e355. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:50:04 user nova-compute[75020]: DEBUG nova.network.neutron [req-cb92ee8c-af0b-4c97-bda3-72d9e86f4852 req-7ebcfc03-0d58-4485-a6d6-ce23e2536be3 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Updating instance_info_cache with network_info: [{"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb92ee8c-af0b-4c97-bda3-72d9e86f4852 req-7ebcfc03-0d58-4485-a6d6-ce23e2536be3 service nova] Releasing lock "refresh_cache-77f4c5de-b6dd-486f-b121-47a08de231a9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG nova.objects.instance [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lazy-loading 'flavor' on Instance uuid 77f4c5de-b6dd-486f-b121-47a08de231a9 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:06 user nova-compute[75020]: INFO nova.compute.manager [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Attaching volume 6a15f350-5d97-411b-8bf5-c811fdfd0bb2 to /dev/sdc
Nov 30 10:50:06 user nova-compute[75020]: DEBUG os_brick.utils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4419143f-5c1d-4eda-b685-8a0da7b6f0b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa94c6-8c13-44a3-9f93-0a70e37e9033]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b590ae2-5d0b-4b01-8b33-f85e8d58b9d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa467d8e-2a12-4f65-a4f6-8484aa990ffd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:07 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6658be3c-150b-4ab9-ac78-c15d6012e403]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.utils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Updating existing volume attachment record: 1222d7d6-232f-47f9-a0b8-8a7c526b2e90 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzDVrxTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:07 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:07 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:07 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[28871b4a-f636-47fc-b0de-4ee2c3e7050c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:50:07 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e93c4f2-7796-4dd3-9432-dfd3355e22ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0] added
Nov 30 10:50:07 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3940910a-4a42-4073-aa2c-7ffa6b4281b9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c0364f-e3af-4de6-948d-4d9687a04e61]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzDVrxTK {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzDVrxTK" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d89bc9-8f52-493d-80a4-114706ac182c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mzDVrxTK'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f94848c-0bb8-46d0-b1a0-5c74e95159ca]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bfedf5-d790-48c8-b83a-8abb2cd088b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:07 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:07 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:07 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:07 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:07 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:07 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:07 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:07 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-f33ad00b-3bbe-4268-9e45-045f540d106f req-1adcccb0-682d-4dae-9064-a6b960f9e982 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-changed-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-f33ad00b-3bbe-4268-9e45-045f540d106f req-1adcccb0-682d-4dae-9064-a6b960f9e982 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Refreshing instance network info cache due to event network-changed-e6718122-9240-4368-987f-7557ca0ed04a. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f33ad00b-3bbe-4268-9e45-045f540d106f req-1adcccb0-682d-4dae-9064-a6b960f9e982 service nova] Acquiring lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f33ad00b-3bbe-4268-9e45-045f540d106f req-1adcccb0-682d-4dae-9064-a6b960f9e982 service nova] Acquired lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:07 user nova-compute[75020]: DEBUG nova.network.neutron [req-f33ad00b-3bbe-4268-9e45-045f540d106f req-1adcccb0-682d-4dae-9064-a6b960f9e982 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Refreshing network info cache for port e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb63d44-7f64-402c-91fd-50c7c8cb9313]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0, portal: 172.16.0.220,3260]
Nov 30 10:50:08 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:08 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aef86df-f2a6-4ea2-91b5-4f25a592523a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[46df0774-2032-482d-b809-357f35464d03]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:08 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:08 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:08 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:08 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:08 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:08 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:08 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:08 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:08 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:08 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec80b3-806f-4908-b0c4-ae0faf5e5a56]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "interface-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "interface-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG nova.objects.instance [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lazy-loading 'flavor' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG nova.network.neutron [req-f33ad00b-3bbe-4268-9e45-045f540d106f req-1adcccb0-682d-4dae-9064-a6b960f9e982 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updated VIF entry in instance network info cache for port e6718122-9240-4368-987f-7557ca0ed04a. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG nova.network.neutron [req-f33ad00b-3bbe-4268-9e45-045f540d106f req-1adcccb0-682d-4dae-9064-a6b960f9e982 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating instance_info_cache with network_info: [{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f33ad00b-3bbe-4268-9e45-045f540d106f req-1adcccb0-682d-4dae-9064-a6b960f9e982 service nova] Releasing lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG nova.objects.instance [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lazy-loading 'pci_requests' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG nova.objects.base [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Object Instance<f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf> lazy-loaded attributes: flavor,pci_requests {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:50:08 user nova-compute[75020]: DEBUG nova.policy [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4aa8049f42b46e5b5b8f894c56927be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941912a981d343bfa3e50a94195ec953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzDVrxTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23530653435633961', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530653435633961', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lazy-loading 'flavor' on Instance uuid 88815763-252f-4506-aa0c-5524e8b96e08 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:50:09 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:09 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:50:09 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:09 user nova-compute[75020]:   <serial>2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0</serial>
Nov 30 10:50:09 user nova-compute[75020]: </disk>
Nov 30 10:50:09 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Successfully created port: 7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] No VIF found with MAC fa:16:3e:fc:c9:3a, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ff41fc2-e7db-4eec-ac94-4748b0b9b751 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.408s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Successfully updated port: 7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquired lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-69bb57c3-c8b9-45e5-9327-3235b3abadcf req-5754e48f-5a42-46ed-9f10-4bf2f915e76a service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-changed-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-69bb57c3-c8b9-45e5-9327-3235b3abadcf req-5754e48f-5a42-46ed-9f10-4bf2f915e76a service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Refreshing instance network info cache due to event network-changed-7b01937f-97ba-45f8-bbb3-cd0bad2453bf. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69bb57c3-c8b9-45e5-9327-3235b3abadcf req-5754e48f-5a42-46ed-9f10-4bf2f915e76a service nova] Acquiring lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:10 user nova-compute[75020]: INFO nova.compute.manager [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Detaching volume 2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0
Nov 30 10:50:10 user nova-compute[75020]: INFO nova.virt.block_device [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Attempting to driver detach volume 2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 from mountpoint /dev/vdb
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Attempting to detach device vdb from instance 88815763-252f-4506-aa0c-5524e8b96e08 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:50:10 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:10 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:50:10 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:10 user nova-compute[75020]:   <serial>2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0</serial>
Nov 30 10:50:10 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:50:10 user nova-compute[75020]: </disk>
Nov 30 10:50:10 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Successfully detached device vdb from instance 88815763-252f-4506-aa0c-5524e8b96e08 from the persistent domain config.
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88815763-252f-4506-aa0c-5524e8b96e08 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:50:10 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:10 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:50:10 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:10 user nova-compute[75020]:   <serial>2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0</serial>
Nov 30 10:50:10 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:50:10 user nova-compute[75020]: </disk>
Nov 30 10:50:10 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating instance_info_cache with network_info: [{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Releasing lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69bb57c3-c8b9-45e5-9327-3235b3abadcf req-5754e48f-5a42-46ed-9f10-4bf2f915e76a service nova] Acquired lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.network.neutron [req-69bb57c3-c8b9-45e5-9327-3235b3abadcf req-5754e48f-5a42-46ed-9f10-4bf2f915e76a service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Refreshing network info cache for port 7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converting VIF {"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG os_vif [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c429fb21-2ac5-5315-81d5-5572ce38a62b', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b01937f-97, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b01937f-97, col_values=(('qos', UUID('adeccb1b-4aa0-4d38-bfc3-6461b7837374')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b01937f-97, col_values=(('external_ids', {'iface-id': '7b01937f-97ba-45f8-bbb3-cd0bad2453bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ad:9c', 'vm-uuid': 'f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: INFO os_vif [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97')
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converting VIF {"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] attach device xml: <interface type="ethernet">
Nov 30 10:50:11 user nova-compute[75020]:   <mac address="fa:16:3e:0b:ad:9c"/>
Nov 30 10:50:11 user nova-compute[75020]:   <model type="virtio"/>
Nov 30 10:50:11 user nova-compute[75020]:   <mtu size="1442"/>
Nov 30 10:50:11 user nova-compute[75020]:   <target dev="tap7b01937f-97"/>
Nov 30 10:50:11 user nova-compute[75020]: </interface>
Nov 30 10:50:11 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88815763-252f-4506-aa0c-5524e8b96e08 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-69bb57c3-c8b9-45e5-9327-3235b3abadcf req-5754e48f-5a42-46ed-9f10-4bf2f915e76a service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updated VIF entry in instance network info cache for port 7b01937f-97ba-45f8-bbb3-cd0bad2453bf. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-69bb57c3-c8b9-45e5-9327-3235b3abadcf req-5754e48f-5a42-46ed-9f10-4bf2f915e76a service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating instance_info_cache with network_info: [{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69bb57c3-c8b9-45e5-9327-3235b3abadcf req-5754e48f-5a42-46ed-9f10-4bf2f915e76a service nova] Releasing lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No BDM found with device name hda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No VIF found with MAC fa:16:3e:dc:cd:4e, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:50:11 user nova-compute[75020]:   <nova:package version="0.0.0"/>
Nov 30 10:50:11 user nova-compute[75020]:   <nova:name>tempest-device-tagging-server-737307002</nova:name>
Nov 30 10:50:11 user nova-compute[75020]:   <nova:creationTime>2023-11-30 10:50:11</nova:creationTime>
Nov 30 10:50:11 user nova-compute[75020]:   <nova:flavor name="m1.tiny">
Nov 30 10:50:11 user nova-compute[75020]:     <nova:memory>512</nova:memory>
Nov 30 10:50:11 user nova-compute[75020]:     <nova:disk>1</nova:disk>
Nov 30 10:50:11 user nova-compute[75020]:     <nova:swap>0</nova:swap>
Nov 30 10:50:11 user nova-compute[75020]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:50:11 user nova-compute[75020]:     <nova:vcpus>1</nova:vcpus>
Nov 30 10:50:11 user nova-compute[75020]:   </nova:flavor>
Nov 30 10:50:11 user nova-compute[75020]:   <nova:owner>
Nov 30 10:50:11 user nova-compute[75020]:     <nova:user uuid="f4aa8049f42b46e5b5b8f894c56927be">tempest-TaggedAttachmentsTest-1620533068-project-member</nova:user>
Nov 30 10:50:11 user nova-compute[75020]:     <nova:project uuid="941912a981d343bfa3e50a94195ec953">tempest-TaggedAttachmentsTest-1620533068</nova:project>
Nov 30 10:50:11 user nova-compute[75020]:   </nova:owner>
Nov 30 10:50:11 user nova-compute[75020]:   <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:50:11 user nova-compute[75020]:   <nova:ports>
Nov 30 10:50:11 user nova-compute[75020]:     <nova:port uuid="e6718122-9240-4368-987f-7557ca0ed04a">
Nov 30 10:50:11 user nova-compute[75020]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 10:50:11 user nova-compute[75020]:     </nova:port>
Nov 30 10:50:11 user nova-compute[75020]:     <nova:port uuid="7b01937f-97ba-45f8-bbb3-cd0bad2453bf">
Nov 30 10:50:11 user nova-compute[75020]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 30 10:50:11 user nova-compute[75020]:     </nova:port>
Nov 30 10:50:11 user nova-compute[75020]:   </nova:ports>
Nov 30 10:50:11 user nova-compute[75020]: </nova:instance>
Nov 30 10:50:11 user nova-compute[75020]:  {{(pid=75020) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 10:50:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fe5be009-b47b-49e7-8181-0b6356fabbf1 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "interface-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.391s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] No waiting events found dispatching network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:12 user nova-compute[75020]: WARNING nova.compute.manager [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received unexpected event network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf for instance with vm_state active and task_state None.
Nov 30 10:50:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] No waiting events found dispatching network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:12 user nova-compute[75020]: WARNING nova.compute.manager [req-9c3b5cf5-5009-4a05-8919-9cf5cadc192f req-be697864-2bee-4cc3-90fb-0b0d394c77ef service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received unexpected event network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf for instance with vm_state active and task_state None.
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lazy-loading 'flavor' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:12 user nova-compute[75020]: INFO nova.compute.manager [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Attaching volume 38cf715c-cf0e-4a5f-996b-390c9eafc7e8 to /dev/vdb
Nov 30 10:50:12 user nova-compute[75020]: DEBUG os_brick.utils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02fc6c3-0351-4b85-a5ec-720067448588]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2fc7f5-f542-46b8-8427-694a29f04821]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1149d07-98e4-4f9d-9f3f-ff0004930f14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[814196f4-41ee-43cb-95a1-4d57865015a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:12 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:50:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[92af98b0-bc10-4ccb-8da6-ba464e0f656e]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG os_brick.utils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating existing volume attachment record: a4e0cdfe-e25d-4dcf-bd2a-98886549d7de {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:50:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-0c69d49f-88eb-4bfc-b6fb-75d3c83368b2 req-62b67a95-3d9f-454e-8fea-18c5007327c7 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received event network-changed-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-0c69d49f-88eb-4bfc-b6fb-75d3c83368b2 req-62b67a95-3d9f-454e-8fea-18c5007327c7 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Refreshing instance network info cache due to event network-changed-d0ded7d3-ee25-4b88-81d7-e74f82502ea1. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:50:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0c69d49f-88eb-4bfc-b6fb-75d3c83368b2 req-62b67a95-3d9f-454e-8fea-18c5007327c7 service nova] Acquiring lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0c69d49f-88eb-4bfc-b6fb-75d3c83368b2 req-62b67a95-3d9f-454e-8fea-18c5007327c7 service nova] Acquired lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:18 user nova-compute[75020]: DEBUG nova.network.neutron [req-0c69d49f-88eb-4bfc-b6fb-75d3c83368b2 req-62b67a95-3d9f-454e-8fea-18c5007327c7 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Refreshing network info cache for port d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:50:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-0c69d49f-88eb-4bfc-b6fb-75d3c83368b2 req-62b67a95-3d9f-454e-8fea-18c5007327c7 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Updated VIF entry in instance network info cache for port d0ded7d3-ee25-4b88-81d7-e74f82502ea1. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:50:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-0c69d49f-88eb-4bfc-b6fb-75d3c83368b2 req-62b67a95-3d9f-454e-8fea-18c5007327c7 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Updating instance_info_cache with network_info: [{"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0c69d49f-88eb-4bfc-b6fb-75d3c83368b2 req-62b67a95-3d9f-454e-8fea-18c5007327c7 service nova] Releasing lock "refresh_cache-546b1a78-e8e9-40ac-ad39-c4eaa1539f91" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMHnPafD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:22 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:22 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:22 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de314ba-176e-46ce-8cdd-6291612e2f20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:50:22 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a7ea9-9122-4de2-b298-26809c728e83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8] added
Nov 30 10:50:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgNetlcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:22 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvheblZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:22 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d38832c-1e0e-4764-bfdd-c70d110d6d8f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bd0e65-ba20-46c5-88b6-22deca626617]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IMHnPafD {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IMHnPafD" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f36a7b-dc50-442b-99da-b118825836cf]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IMHnPafD'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lazy-loading 'flavor' on Instance uuid 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[861143f5-ead4-45fb-a64f-a9c132870be8]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8072dc06-7b06-4189-ae57-1c51b84332e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac7bfa-0bc9-409b-8b74-613085bd8363]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8, portal: 172.16.0.220,3260]
Nov 30 10:50:22 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdd100c-4137-4975-8ee2-d3bb850085c9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd98494-c2e6-4566-b800-2d69e96c9e35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:22 user nova-compute[75020]: INFO nova.compute.manager [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Attaching volume 26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 to /dev/vdb
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4578dea-23c2-43b0-8538-8d6d3b4568f8]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMHnPafD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.utils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c7dd99-3cad-40f9-a8ee-aa0b4b56e5cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd1601-9b47-4278-86cc-62883be7778e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f37e0c-fd38-44b9-a75f-28f280f17c7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb722f6-a11d-43c0-8316-3c4c920a27a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:22 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:50:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bbb03a-219c-41d0-8888-ef1868545148]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG os_brick.utils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Updating existing volume attachment record: 7ec7b777-b624-495b-83fd-f9d5539ccff0 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:50:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23163646361386165', 'path': '/dev/sdg'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163646361386165', 'path': '/dev/sdg'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.307s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:23 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:23 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lazy-loading 'flavor' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc7ea2-b744-4e7d-bc01-a8724efde72c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:50:23 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[974884cf-9abf-423c-a988-3741544a4d05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44] added
Nov 30 10:50:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:50:23 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:23 user nova-compute[75020]:   <source dev="/dev/sdg"/>
Nov 30 10:50:23 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:23 user nova-compute[75020]:   <serial>38cf715c-cf0e-4a5f-996b-390c9eafc7e8</serial>
Nov 30 10:50:23 user nova-compute[75020]: </disk>
Nov 30 10:50:23 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80d37cf-4971-49b2-8c3d-2f06630e669c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b75a87c-ebf8-45fa-982a-6858559b20ec]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgNetlcf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgNetlcf" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[28238366-d18a-46f1-acf8-d1f579017535]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RgNetlcf'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e3990-93bc-4f19-92b7-bec737331150]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[add358bf-ec89-49ba-9519-b4dd6098bded]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[10892932-ac7a-46af-bd98-fefae73b7f54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44, portal: 172.16.0.220,3260]
Nov 30 10:50:23 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1acccc8-c307-419b-b217-527f8511ee48]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[64777278-ba1a-4d5c-b233-18aa4c5a6df5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaa2085-0c2d-4383-b4f1-37b24d5782d0]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgNetlcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No BDM found with device name hda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] No VIF found with MAC fa:16:3e:dc:cd:4e, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0cf66ca-022a-4ac9-a897-569a203fbbfa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.750s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] <== connect_volume: return (2640ms) {'type': 'block', 'scsi_wwn': '23833343232343232', 'path': '/dev/sdh'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833343232343232', 'path': '/dev/sdh'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.637s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:24 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG nova.objects.instance [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lazy-loading 'flavor' on Instance uuid 77a73463-ea12-43c3-83a4-803f4a535010 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e897946-34c3-4b92-9591-2aadb8170e19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:50:24 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:50:24 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:24 user nova-compute[75020]:   <source dev="/dev/sdh"/>
Nov 30 10:50:24 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:24 user nova-compute[75020]:   <serial>28ce2c33-7e7a-40ae-8565-4092f5421a44</serial>
Nov 30 10:50:24 user nova-compute[75020]: </disk>
Nov 30 10:50:24 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d294227c-3c0c-4f67-a77a-afa74d29ce4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2] added
Nov 30 10:50:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[11786254-f6bd-407a-9a05-441dd8889d58]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d447f95-c1d7-4b79-9892-a30e7599b5cd]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvheblZJ {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvheblZJ" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca38de0-80ca-498a-8fc9-025549bdaaf4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QvheblZJ'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[df13fa8d-11c4-47ad-885b-d96fc414e040]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9a6020-18ae-4020-852a-a6d6d1cb3907]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:24 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:24 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:24 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:24 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:24 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:24 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cb99e6-676a-43a7-a493-4cbba8cceb8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2, portal: 172.16.0.220,3260]
Nov 30 10:50:25 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c502eaca-e9ae-4803-8455-ed4f3fc2fd74]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5aa37e-e624-4d3d-b11d-dfb5b4595b95]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:25 user nova-compute[75020]: INFO nova.compute.manager [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Detaching volume 38cf715c-cf0e-4a5f-996b-390c9eafc7e8
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6f275-9073-491e-9215-c102561d918d]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvheblZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:50:25 user nova-compute[75020]: INFO nova.virt.block_device [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Attempting to driver detach volume 38cf715c-cf0e-4a5f-996b-390c9eafc7e8 from mountpoint /dev/vdb
Nov 30 10:50:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] No VIF found with MAC fa:16:3e:b8:43:61, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Attempting to detach device vdb from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:50:25 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:25 user nova-compute[75020]:   <source dev="/dev/sdg"/>
Nov 30 10:50:25 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:25 user nova-compute[75020]:   <serial>38cf715c-cf0e-4a5f-996b-390c9eafc7e8</serial>
Nov 30 10:50:25 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 10:50:25 user nova-compute[75020]: </disk>
Nov 30 10:50:25 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:25 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Successfully detached device vdb from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf from the persistent domain config.
Nov 30 10:50:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:50:25 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:25 user nova-compute[75020]:   <source dev="/dev/sdg"/>
Nov 30 10:50:25 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:25 user nova-compute[75020]:   <serial>38cf715c-cf0e-4a5f-996b-390c9eafc7e8</serial>
Nov 30 10:50:25 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 10:50:25 user nova-compute[75020]: </disk>
Nov 30 10:50:25 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-845d63a6-5a1d-45be-8d94-7994ce9d18e5 tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.068s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "77a73463-ea12-43c3-83a4-803f4a535010" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG os_brick.utils [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dfce84-125a-4da4-a5a4-69ef4bee030d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea16655-6626-44bb-a3de-f9045c318537]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[531a8f5e-1b3d-4f5f-8fe6-56fdb90bed74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8381f7-b81a-4699-992f-78747df1e248]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:26 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[12da685d-259a-41ef-9690-e8fe8a0c193b]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG os_brick.utils [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] <== connect_volume: return (4026ms) {'type': 'block', 'scsi_wwn': '26565646636346631', 'path': '/dev/sdi'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565646636346631', 'path': '/dev/sdi'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG nova.objects.instance [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lazy-loading 'flavor' on Instance uuid 77f4c5de-b6dd-486f-b121-47a08de231a9 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:26 user nova-compute[75020]: INFO nova.compute.manager [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Swapping volume 28ce2c33-7e7a-40ae-8565-4092f5421a44 for 77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:50:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:50:26 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:26 user nova-compute[75020]:   <source dev="/dev/sdi"/>
Nov 30 10:50:26 user nova-compute[75020]:   <target dev="sdc" bus="scsi"/>
Nov 30 10:50:26 user nova-compute[75020]:   <serial>6a15f350-5d97-411b-8bf5-c811fdfd0bb2</serial>
Nov 30 10:50:26 user nova-compute[75020]:   <address type="drive" controller="0" unit="2"/>
Nov 30 10:50:26 user nova-compute[75020]: </disk>
Nov 30 10:50:26 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] No BDM found with device name sda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] No VIF found with MAC fa:16:3e:e3:14:e7, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:50:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-22516def-f751-4b3b-90e7-4fb7b7f4e7dd tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.982s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:27 user nova-compute[75020]: INFO nova.compute.manager [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Detaching volume 6a15f350-5d97-411b-8bf5-c811fdfd0bb2
Nov 30 10:50:27 user nova-compute[75020]: INFO nova.virt.block_device [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Attempting to driver detach volume 6a15f350-5d97-411b-8bf5-c811fdfd0bb2 from mountpoint /dev/sdc
Nov 30 10:50:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Attempting to detach device sdc from instance 77f4c5de-b6dd-486f-b121-47a08de231a9 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:50:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:50:28 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:28 user nova-compute[75020]:   <source dev="/dev/sdi"/>
Nov 30 10:50:28 user nova-compute[75020]:   <target dev="sdc" bus="scsi"/>
Nov 30 10:50:28 user nova-compute[75020]:   <serial>6a15f350-5d97-411b-8bf5-c811fdfd0bb2</serial>
Nov 30 10:50:28 user nova-compute[75020]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 10:50:28 user nova-compute[75020]: </disk>
Nov 30 10:50:28 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Successfully detached device sdc from instance 77f4c5de-b6dd-486f-b121-47a08de231a9 from the persistent domain config.
Nov 30 10:50:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 77f4c5de-b6dd-486f-b121-47a08de231a9 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:50:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:50:28 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:28 user nova-compute[75020]:   <source dev="/dev/sdi"/>
Nov 30 10:50:28 user nova-compute[75020]:   <target dev="sdc" bus="scsi"/>
Nov 30 10:50:28 user nova-compute[75020]:   <serial>6a15f350-5d97-411b-8bf5-c811fdfd0bb2</serial>
Nov 30 10:50:28 user nova-compute[75020]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 10:50:28 user nova-compute[75020]: </disk>
Nov 30 10:50:28 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 77f4c5de-b6dd-486f-b121-47a08de231a9 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:31 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88815763-252f-4506-aa0c-5524e8b96e08 is timed out.
Nov 30 10:50:31 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Successfully detached device vdb from instance 88815763-252f-4506-aa0c-5524e8b96e08 from the live domain config.
Nov 30 10:50:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzDVrxTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:31 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e7320-147c-4621-abc3-a306f0e0d2b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:50:31 user nova-compute[75020]: No targets found.
Nov 30 10:50:31 user nova-compute[75020]: iSNS:
Nov 30 10:50:31 user nova-compute[75020]: No targets found.
Nov 30 10:50:31 user nova-compute[75020]: STATIC:
Nov 30 10:50:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44
Nov 30 10:50:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c
Nov 30 10:50:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:50:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8
Nov 30 10:50:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be
Nov 30 10:50:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0
Nov 30 10:50:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6
Nov 30 10:50:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2
Nov 30 10:50:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:31 user nova-compute[75020]: FIRMWARE:
Nov 30 10:50:31 user nova-compute[75020]: No targets found.
Nov 30 10:50:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:50:31 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:50:31 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4a8948-fe43-4bf9-a9cf-c816e8ff326e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a97ebc-38eb-4798-8561-b36f35d7afac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada875ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[547fe56d-7623-4017-8561-8f7b4c8438b7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b1381-7bd4-4e23-85cd-49d805e4823f]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eabe405-e4d1-422e-acbd-6e16f98715e5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae69f0cb-a439-4eea-bcb2-9bb5426eb7f8]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3ff9b1-7832-4801-b2c9-897b1dc27562]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc74f9c8-3a1f-47d9-a0e5-0c722b74f324]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0, portal: 172.16.0.220,3260]
Nov 30 10:50:31 user nova-compute[75020]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7faaf9-f174-4e8f-8b78-2bc4b34cb2e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa40399-c014-4cb4-a3b5-6c0f21863d37]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] <== disconnect_volume: return (345ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:50:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lazy-loading 'flavor' on Instance uuid 88815763-252f-4506-aa0c-5524e8b96e08 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b7e6d7c7-542e-4ed0-8b15-dbfeb8d5cde5 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.929s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:50:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7242MB free_disk=25.467453002929688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 88815763-252f-4506-aa0c-5524e8b96e08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77a73463-ea12-43c3-83a4-803f4a535010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77f4c5de-b6dd-486f-b121-47a08de231a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9ad945a-9ce1-4d42-888c-18e660b9d67c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:50:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoOFGuIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:41 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:41 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:41 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59e9180-d39d-47ce-b58f-e91397232437]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:50:41 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492dda6-0200-4d85-8dc6-2cf2e219a496]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8] added
Nov 30 10:50:41 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dukOrZFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '77a73463-ea12-43c3-83a4-803f4a535010', 'attached_at': '', 'detached_at': '', 'volume_id': '77ca61d2-17b6-4840-9967-47da7e0ac5de', 'serial': '77ca61d2-17b6-4840-9967-47da7e0ac5de'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgNetlcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '77a73463-ea12-43c3-83a4-803f4a535010', 'attached_at': '', 'detached_at': '', 'volume_id': '28ce2c33-7e7a-40ae-8565-4092f5421a44', 'serial'} {{(pid=75020) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9261da5b-7ed0-40e9-9fde-7d92872d3b53]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dukOrZFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:41 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e938f9-a23b-4763-ab3d-13b8b6a3000e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoOFGuIL {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoOFGuIL" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c40d597-ad37-4057-aa16-e30f4006c51d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KoOFGuIL'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd149f6-bb9e-418d-bc2b-c7b711c63e33]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b695009-f7f8-4b5b-bc5a-cb44658671d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f022d5-098d-4e9b-a606-c7cd55f57e10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8, portal: 172.16.0.220,3260]
Nov 30 10:50:42 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0390fee-78b3-4f0f-946f-ceec9c815ccb]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updating instance_info_cache with network_info: [{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77867c-c9b4-4ad5-81a4-84a21a6337f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd9e9c8-0797-44be-8d70-4083ab6f8ac2]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:50:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoOFGuIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26633343262326665', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633343262326665', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.288s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:43 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:43 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lazy-loading 'flavor' on Instance uuid 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b2f24-189b-4cf8-8996-5ed1a9b83707]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:50:43 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] attach device xml: <disk type="block" device="disk">
Nov 30 10:50:43 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:43 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:50:43 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:43 user nova-compute[75020]:   <serial>26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8</serial>
Nov 30 10:50:43 user nova-compute[75020]: </disk>
Nov 30 10:50:43 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7801bdf1-571f-4557-bf21-943ff1739d28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de] added
Nov 30 10:50:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c810ce-a953-45f6-8ea0-90d37fcb9ef2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f824c65-d8e9-4e90-a40a-42c71bfbbf91]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dukOrZFo {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dukOrZFo" returned: 0 in 0.034s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf27e8f2-1414-47e8-8adc-fcb069b921d0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dukOrZFo'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[733c124e-7fcc-4cab-9565-fe486bd19ff8]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a429a78-2f77-4c93-8954-57d6f85b4862]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb941af-df8a-454a-9875-49cd140c2207]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de, portal: 172.16.0.220,3260]
Nov 30 10:50:43 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2739d98-68ef-4526-b9d4-de5a3d8f9eff]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[684d3bbc-0853-4270-9136-ed99567e350a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18e20a-b067-4adf-924d-863409573800]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dukOrZFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] No VIF found with MAC fa:16:3e:9e:45:44, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "9768f14b-9e34-421e-be7c-e541442814e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8233c00c-b93c-40dc-9b49-ddf0f2b789d8 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.423s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:43 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:50:43 user nova-compute[75020]: INFO nova.compute.claims [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Claim successful on node user
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:50:44 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:50:44 user nova-compute[75020]: INFO nova.virt.block_device [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Booting with blank volume at /dev/vda
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.policy [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a93ae25dec664c44ba88b0f15f6a239e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02acda28c914dcdaa8afa65411b8055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-473bcfc7-2435-4eb1-bfc9-b8d5a6fc5139 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] volume_snapshot_create: create_info: {'snapshot_id': 'd6344a8c-b249-4cdd-b3d4-ef90bd86baed', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75020) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] <== connect_volume: return (2678ms) {'type': 'block', 'scsi_wwn': '26531626366386439', 'path': '/dev/sdj'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531626366386439', 'path': '/dev/sdj'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-473bcfc7-2435-4eb1-bfc9-b8d5a6fc5139 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] snap xml: <domainsnapshot>
Nov 30 10:50:44 user nova-compute[75020]:   <disks>
Nov 30 10:50:44 user nova-compute[75020]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 30 10:50:44 user nova-compute[75020]:       <source file="/dev/new_file"/>
Nov 30 10:50:44 user nova-compute[75020]:     </disk>
Nov 30 10:50:44 user nova-compute[75020]:     <disk name="vda" snapshot="no"/>
Nov 30 10:50:44 user nova-compute[75020]:   </disks>
Nov 30 10:50:44 user nova-compute[75020]: </domainsnapshot>
Nov 30 10:50:44 user nova-compute[75020]:  {{(pid=75020) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.objects.instance [None req-473bcfc7-2435-4eb1-bfc9-b8d5a6fc5139 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] Lazy-loading 'system_metadata' on Instance uuid 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.objects.instance [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lazy-loading 'flavor' on Instance uuid 77a73463-ea12-43c3-83a4-803f4a535010 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:44 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-473bcfc7-2435-4eb1-bfc9-b8d5a6fc5139 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 10:50:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-1756df0f-88bc-4823-92cf-ee29746dca30 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] volume_snapshot_delete: delete_info: {'volume_id': '26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8'} {{(pid=75020) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [None req-1756df0f-88bc-4823-92cf-ee29746dca30 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     if delete_info['type'] != 'qcow2':
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] KeyError: 'type'
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [None req-473bcfc7-2435-4eb1-bfc9-b8d5a6fc5139 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     rv = execute(f, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     six.reraise(c, e, tb)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     raise value
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     rv = meth(*args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [None req-473bcfc7-2435-4eb1-bfc9-b8d5a6fc5139 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     self._volume_snapshot_create(context, instance, guest,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     rv = execute(f, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     six.reraise(c, e, tb)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     raise value
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     rv = meth(*args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [None req-1756df0f-88bc-4823-92cf-ee29746dca30 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-66bb5466-ec7f-4745-84e4-57fcaab35ae0)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server [None req-1756df0f-88bc-4823-92cf-ee29746dca30 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] Exception during message handling: KeyError: 'type'
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver [None req-473bcfc7-2435-4eb1-bfc9-b8d5a6fc5139 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot d6344a8c-b249-4cdd-b3d4-ef90bd86baed could not be found.
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     raise value
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot d6344a8c-b249-4cdd-b3d4-ef90bd86baed could not be found. (HTTP 404) (Request-ID: req-88393ffa-5882-449f-9b0c-24daf48bb9c5)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot d6344a8c-b249-4cdd-b3d4-ef90bd86baed could not be found.
Nov 30 10:50:44 user nova-compute[75020]: ERROR nova.virt.libvirt.driver 
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server [None req-473bcfc7-2435-4eb1-bfc9-b8d5a6fc5139 tempest-VolumesAssistedSnapshotsTest-712310323 tempest-VolumesAssistedSnapshotsTest-712310323-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise value
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 10:50:44 user nova-compute[75020]: ERROR oslo_messaging.rpc.server 
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:45 user nova-compute[75020]: INFO nova.compute.manager [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Detaching volume 26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8
Nov 30 10:50:45 user nova-compute[75020]: INFO nova.virt.block_device [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Attempting to driver detach volume 26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 from mountpoint /dev/vdb
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Attempting to detach device vdb from instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 10:50:45 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:45 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:50:45 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:45 user nova-compute[75020]:   <serial>26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8</serial>
Nov 30 10:50:45 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:50:45 user nova-compute[75020]: </disk>
Nov 30 10:50:45 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:45 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Successfully detached device vdb from instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 from the persistent domain config.
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 10:50:45 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:50:45 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:50:45 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:50:45 user nova-compute[75020]:   <serial>26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8</serial>
Nov 30 10:50:45 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:50:45 user nova-compute[75020]: </disk>
Nov 30 10:50:45 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Successfully created port: e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 179306496 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:45 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf is timed out.
Nov 30 10:50:45 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Successfully detached device vdb from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf from the live domain config.
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMHnPafD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:45 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2065935b-d3e2-49be-8f67-e99c176ae1bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:50:45 user nova-compute[75020]: No targets found.
Nov 30 10:50:45 user nova-compute[75020]: iSNS:
Nov 30 10:50:45 user nova-compute[75020]: No targets found.
Nov 30 10:50:45 user nova-compute[75020]: STATIC:
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2
Nov 30 10:50:45 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:45 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:45 user nova-compute[75020]: FIRMWARE:
Nov 30 10:50:45 user nova-compute[75020]: No targets found.
Nov 30 10:50:45 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:50:45 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:50:45 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb561118-0d4c-4f9e-ab63-af1c21c68174]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b761c4c-ab2f-4761-ad53-1733c12a7b93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:45 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada8442f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8'): ({'sdg'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Removing single pathed devices sdg {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[760536b9-cafa-46cf-8276-1ae7ef2ebaaa]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4961009-af8a-487f-978c-687d9e8a20e2]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Flushing IO for device /dev/sdg {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f6db2d-61ec-4773-9148-16e872af916f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26e54bb-2499-490c-aee3-3cd37b35ed38]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] SCSI volumes sdg have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:50:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee27fa2b-7e94-4860-8ffe-b61da0adf467]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cb6aca-9522-4fa1-9176-0bdd9d80cef3]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8, portal: 172.16.0.220,3260]
Nov 30 10:50:46 user nova-compute[75020]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 311427072 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38cf715c-cf0e-4a5f-996b-390c9eafc7e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ff9951-771c-4cc7-af16-71ffec940635]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] <== disconnect_volume: return (414ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Successfully updated port: e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquired lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.compute.manager [req-2d7eac95-9fc7-404d-a9bb-8bdcfc27a31d req-c0ca7081-3a06-40f0-bc8d-a9a84f45e8ad service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-changed-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.compute.manager [req-2d7eac95-9fc7-404d-a9bb-8bdcfc27a31d req-c0ca7081-3a06-40f0-bc8d-a9a84f45e8ad service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Refreshing instance network info cache due to event network-changed-e6d72d13-bbe8-4450-ab51-a898223e1ca2. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d7eac95-9fc7-404d-a9bb-8bdcfc27a31d req-c0ca7081-3a06-40f0-bc8d-a9a84f45e8ad service nova] Acquiring lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 448790528 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating instance_info_cache with network_info: [{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Releasing lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance network_info: |[{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d7eac95-9fc7-404d-a9bb-8bdcfc27a31d req-c0ca7081-3a06-40f0-bc8d-a9a84f45e8ad service nova] Acquired lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:46 user nova-compute[75020]: DEBUG nova.network.neutron [req-2d7eac95-9fc7-404d-a9bb-8bdcfc27a31d req-c0ca7081-3a06-40f0-bc8d-a9a84f45e8ad service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Refreshing network info cache for port e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:50:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 577765376 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-2d7eac95-9fc7-404d-a9bb-8bdcfc27a31d req-c0ca7081-3a06-40f0-bc8d-a9a84f45e8ad service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updated VIF entry in instance network info cache for port e6d72d13-bbe8-4450-ab51-a898223e1ca2. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:50:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-2d7eac95-9fc7-404d-a9bb-8bdcfc27a31d req-c0ca7081-3a06-40f0-bc8d-a9a84f45e8ad service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating instance_info_cache with network_info: [{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d7eac95-9fc7-404d-a9bb-8bdcfc27a31d req-c0ca7081-3a06-40f0-bc8d-a9a84f45e8ad service nova] Releasing lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 711983104 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lazy-loading 'flavor' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 818937856 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8468a2d5-16b9-445d-9a2e-a86eb65c2afa tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.053s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:48 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 77f4c5de-b6dd-486f-b121-47a08de231a9 is timed out.
Nov 30 10:50:48 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Successfully detached device sdc from instance 77f4c5de-b6dd-486f-b121-47a08de231a9 from the live domain config.
Nov 30 10:50:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvheblZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:48 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa06c48e-6e20-4111-a9fe-3ff70afe2452]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:50:48 user nova-compute[75020]: No targets found.
Nov 30 10:50:48 user nova-compute[75020]: iSNS:
Nov 30 10:50:48 user nova-compute[75020]: No targets found.
Nov 30 10:50:48 user nova-compute[75020]: STATIC:
Nov 30 10:50:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44
Nov 30 10:50:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c
Nov 30 10:50:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8
Nov 30 10:50:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:50:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be
Nov 30 10:50:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:50:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6
Nov 30 10:50:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2
Nov 30 10:50:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:48 user nova-compute[75020]: FIRMWARE:
Nov 30 10:50:48 user nova-compute[75020]: No targets found.
Nov 30 10:50:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:50:48 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:50:48 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c315c4f0-405d-473f-90be-f3cc7d1bdbc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a2fd36-f2e6-45b5-9024-cd9952bff4a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad887d60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2'): ({'sdi'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Removing single pathed devices sdi {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[147652af-ad1b-4ace-9417-c5663c37e93e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[116a98c2-1ac2-4159-9935-f86131830591]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Flushing IO for device /dev/sdi {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed6dc34-8ad4-45a2-977b-eb8609329508]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ccb8e7-7c5d-423e-b6cb-1e42488251cc]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] SCSI volumes sdi have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49df2f4-e918-4493-b1f0-45e9d2629620]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 981467136 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c04f56-9e90-496f-b1ac-91dd5082c8bc]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2, portal: 172.16.0.220,3260]
Nov 30 10:50:48 user nova-compute[75020]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a15f350-5d97-411b-8bf5-c811fdfd0bb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3927e088-cb75-4813-814f-2b08afce61cf]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] <== disconnect_volume: return (391ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "interface-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-7b01937f-97ba-45f8-bbb3-cd0bad2453bf" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "interface-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-7b01937f-97ba-45f8-bbb3-cd0bad2453bf" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lazy-loading 'flavor' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converting VIF {"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface> {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface> {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Attempting to detach device tap7b01937f-97 from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] detach device xml: <interface type="ethernet">
Nov 30 10:50:49 user nova-compute[75020]:   <mac address="fa:16:3e:0b:ad:9c"/>
Nov 30 10:50:49 user nova-compute[75020]:   <model type="virtio"/>
Nov 30 10:50:49 user nova-compute[75020]:   <mtu size="1442"/>
Nov 30 10:50:49 user nova-compute[75020]:   <target dev="tap7b01937f-97"/>
Nov 30 10:50:49 user nova-compute[75020]: </interface>
Nov 30 10:50:49 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface> {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 30 10:50:49 user nova-compute[75020]:   <name>instance-00000009</name>
Nov 30 10:50:49 user nova-compute[75020]:   <uuid>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</uuid>
Nov 30 10:50:49 user nova-compute[75020]:   <metadata>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:50:49 user nova-compute[75020]:   <nova:package version="0.0.0"/>
Nov 30 10:50:49 user nova-compute[75020]:   <nova:name>tempest-device-tagging-server-737307002</nova:name>
Nov 30 10:50:49 user nova-compute[75020]:   <nova:creationTime>2023-11-30 10:50:11</nova:creationTime>
Nov 30 10:50:49 user nova-compute[75020]:   <nova:flavor name="m1.tiny">
Nov 30 10:50:49 user nova-compute[75020]:     <nova:memory>512</nova:memory>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:disk>1</nova:disk>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:swap>0</nova:swap>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:vcpus>1</nova:vcpus>
Nov 30 10:50:49 user nova-compute[75020]:   </nova:flavor>
Nov 30 10:50:49 user nova-compute[75020]:   <nova:owner>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:user uuid="f4aa8049f42b46e5b5b8f894c56927be">tempest-TaggedAttachmentsTest-1620533068-project-member</nova:user>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:project uuid="941912a981d343bfa3e50a94195ec953">tempest-TaggedAttachmentsTest-1620533068</nova:project>
Nov 30 10:50:49 user nova-compute[75020]:   </nova:owner>
Nov 30 10:50:49 user nova-compute[75020]:   <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:50:49 user nova-compute[75020]:   <nova:ports>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:port uuid="e6718122-9240-4368-987f-7557ca0ed04a">
Nov 30 10:50:49 user nova-compute[75020]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 10:50:49 user nova-compute[75020]:     </nova:port>
Nov 30 10:50:49 user nova-compute[75020]:     <nova:port uuid="7b01937f-97ba-45f8-bbb3-cd0bad2453bf">
Nov 30 10:50:49 user nova-compute[75020]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 30 10:50:49 user nova-compute[75020]:     </nova:port>
Nov 30 10:50:49 user nova-compute[75020]:   </nova:ports>
Nov 30 10:50:49 user nova-compute[75020]: </nova:instance>
Nov 30 10:50:49 user nova-compute[75020]:   </metadata>
Nov 30 10:50:49 user nova-compute[75020]:   <memory unit='KiB'>524288</memory>
Nov 30 10:50:49 user nova-compute[75020]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 10:50:49 user nova-compute[75020]:   <vcpu placement='static'>1</vcpu>
Nov 30 10:50:49 user nova-compute[75020]:   <resource>
Nov 30 10:50:49 user nova-compute[75020]:     <partition>/machine</partition>
Nov 30 10:50:49 user nova-compute[75020]:   </resource>
Nov 30 10:50:49 user nova-compute[75020]:   <sysinfo type='smbios'>
Nov 30 10:50:49 user nova-compute[75020]:     <system>
Nov 30 10:50:49 user nova-compute[75020]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 10:50:49 user nova-compute[75020]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 10:50:49 user nova-compute[75020]:       <entry name='version'>0.0.0</entry>
Nov 30 10:50:49 user nova-compute[75020]:       <entry name='serial'>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:50:49 user nova-compute[75020]:       <entry name='uuid'>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:50:49 user nova-compute[75020]:       <entry name='family'>Virtual Machine</entry>
Nov 30 10:50:49 user nova-compute[75020]:     </system>
Nov 30 10:50:49 user nova-compute[75020]:   </sysinfo>
Nov 30 10:50:49 user nova-compute[75020]:   <os>
Nov 30 10:50:49 user nova-compute[75020]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 10:50:49 user nova-compute[75020]:     <boot dev='hd'/>
Nov 30 10:50:49 user nova-compute[75020]:     <smbios mode='sysinfo'/>
Nov 30 10:50:49 user nova-compute[75020]:   </os>
Nov 30 10:50:49 user nova-compute[75020]:   <features>
Nov 30 10:50:49 user nova-compute[75020]:     <acpi/>
Nov 30 10:50:49 user nova-compute[75020]:     <apic/>
Nov 30 10:50:49 user nova-compute[75020]:     <vmcoreinfo state='on'/>
Nov 30 10:50:49 user nova-compute[75020]:   </features>
Nov 30 10:50:49 user nova-compute[75020]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 10:50:49 user nova-compute[75020]:     <model fallback='forbid'>Nehalem</model>
Nov 30 10:50:49 user nova-compute[75020]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 10:50:49 user nova-compute[75020]:     <feature policy='require' name='vme'/>
Nov 30 10:50:49 user nova-compute[75020]:     <feature policy='require' name='x2apic'/>
Nov 30 10:50:49 user nova-compute[75020]:     <feature policy='require' name='hypervisor'/>
Nov 30 10:50:49 user nova-compute[75020]:   </cpu>
Nov 30 10:50:49 user nova-compute[75020]:   <clock offset='utc'>
Nov 30 10:50:49 user nova-compute[75020]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 10:50:49 user nova-compute[75020]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 10:50:49 user nova-compute[75020]:     <timer name='hpet' present='no'/>
Nov 30 10:50:49 user nova-compute[75020]:   </clock>
Nov 30 10:50:49 user nova-compute[75020]:   <on_poweroff>destroy</on_poweroff>
Nov 30 10:50:49 user nova-compute[75020]:   <on_reboot>restart</on_reboot>
Nov 30 10:50:49 user nova-compute[75020]:   <on_crash>destroy</on_crash>
Nov 30 10:50:49 user nova-compute[75020]:   <devices>
Nov 30 10:50:49 user nova-compute[75020]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 10:50:49 user nova-compute[75020]:     <disk type='file' device='disk'>
Nov 30 10:50:49 user nova-compute[75020]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 10:50:49 user nova-compute[75020]:       <source file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk' index='2'/>
Nov 30 10:50:49 user nova-compute[75020]:       <backingStore type='file' index='3'>
Nov 30 10:50:49 user nova-compute[75020]:         <format type='raw'/>
Nov 30 10:50:49 user nova-compute[75020]:         <source file='/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814'/>
Nov 30 10:50:49 user nova-compute[75020]:         <backingStore/>
Nov 30 10:50:49 user nova-compute[75020]:       </backingStore>
Nov 30 10:50:49 user nova-compute[75020]:       <target dev='vda' bus='virtio'/>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='virtio-disk0'/>
Nov 30 10:50:49 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </disk>
Nov 30 10:50:49 user nova-compute[75020]:     <disk type='file' device='cdrom'>
Nov 30 10:50:49 user nova-compute[75020]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 10:50:49 user nova-compute[75020]:       <source file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.config' index='1'/>
Nov 30 10:50:49 user nova-compute[75020]:       <backingStore/>
Nov 30 10:50:49 user nova-compute[75020]:       <target dev='hda' bus='ide'/>
Nov 30 10:50:49 user nova-compute[75020]:       <readonly/>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='ide0-0-0'/>
Nov 30 10:50:49 user nova-compute[75020]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </disk>
Nov 30 10:50:49 user nova-compute[75020]:     <controller type='usb' index='0' model='none'>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='usb'/>
Nov 30 10:50:49 user nova-compute[75020]:     </controller>
Nov 30 10:50:49 user nova-compute[75020]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='pci.0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </controller>
Nov 30 10:50:49 user nova-compute[75020]:     <controller type='ide' index='0'>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='ide'/>
Nov 30 10:50:49 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 10:50:49 user nova-compute[75020]:     </controller>
Nov 30 10:50:49 user nova-compute[75020]:     <interface type='ethernet'>
Nov 30 10:50:49 user nova-compute[75020]:       <mac address='fa:16:3e:dc:cd:4e'/>
Nov 30 10:50:49 user nova-compute[75020]:       <target dev='tape6718122-92'/>
Nov 30 10:50:49 user nova-compute[75020]:       <model type='virtio'/>
Nov 30 10:50:49 user nova-compute[75020]:       <mtu size='1442'/>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='net0'/>
Nov 30 10:50:49 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </interface>
Nov 30 10:50:49 user nova-compute[75020]:     <interface type='ethernet'>
Nov 30 10:50:49 user nova-compute[75020]:       <mac address='fa:16:3e:0b:ad:9c'/>
Nov 30 10:50:49 user nova-compute[75020]:       <target dev='tap7b01937f-97'/>
Nov 30 10:50:49 user nova-compute[75020]:       <model type='virtio'/>
Nov 30 10:50:49 user nova-compute[75020]:       <mtu size='1442'/>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='net1'/>
Nov 30 10:50:49 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </interface>
Nov 30 10:50:49 user nova-compute[75020]:     <serial type='pty'>
Nov 30 10:50:49 user nova-compute[75020]:       <source path='/dev/pts/8'/>
Nov 30 10:50:49 user nova-compute[75020]:       <log file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log' append='off'/>
Nov 30 10:50:49 user nova-compute[75020]:       <target type='isa-serial' port='0'>
Nov 30 10:50:49 user nova-compute[75020]:         <model name='isa-serial'/>
Nov 30 10:50:49 user nova-compute[75020]:       </target>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='serial0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </serial>
Nov 30 10:50:49 user nova-compute[75020]:     <console type='pty' tty='/dev/pts/8'>
Nov 30 10:50:49 user nova-compute[75020]:       <source path='/dev/pts/8'/>
Nov 30 10:50:49 user nova-compute[75020]:       <log file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log' append='off'/>
Nov 30 10:50:49 user nova-compute[75020]:       <target type='serial' port='0'/>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='serial0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </console>
Nov 30 10:50:49 user nova-compute[75020]:     <input type='mouse' bus='ps2'>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='input0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </input>
Nov 30 10:50:49 user nova-compute[75020]:     <input type='keyboard' bus='ps2'>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='input1'/>
Nov 30 10:50:49 user nova-compute[75020]:     </input>
Nov 30 10:50:49 user nova-compute[75020]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 30 10:50:49 user nova-compute[75020]:       <listen type='address' address='0.0.0.0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </graphics>
Nov 30 10:50:49 user nova-compute[75020]:     <audio id='1' type='none'/>
Nov 30 10:50:49 user nova-compute[75020]:     <video>
Nov 30 10:50:49 user nova-compute[75020]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='video0'/>
Nov 30 10:50:49 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </video>
Nov 30 10:50:49 user nova-compute[75020]:     <memballoon model='virtio'>
Nov 30 10:50:49 user nova-compute[75020]:       <stats period='10'/>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='balloon0'/>
Nov 30 10:50:49 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </memballoon>
Nov 30 10:50:49 user nova-compute[75020]:     <rng model='virtio'>
Nov 30 10:50:49 user nova-compute[75020]:       <backend model='random'>/dev/urandom</backend>
Nov 30 10:50:49 user nova-compute[75020]:       <alias name='rng0'/>
Nov 30 10:50:49 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 10:50:49 user nova-compute[75020]:     </rng>
Nov 30 10:50:49 user nova-compute[75020]:   </devices>
Nov 30 10:50:49 user nova-compute[75020]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 10:50:49 user nova-compute[75020]:     <label>libvirt-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</label>
Nov 30 10:50:49 user nova-compute[75020]:     <imagelabel>libvirt-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</imagelabel>
Nov 30 10:50:49 user nova-compute[75020]:   </seclabel>
Nov 30 10:50:49 user nova-compute[75020]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 10:50:49 user nova-compute[75020]:     <label>+64055:+108</label>
Nov 30 10:50:49 user nova-compute[75020]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 10:50:49 user nova-compute[75020]:   </seclabel>
Nov 30 10:50:49 user nova-compute[75020]: </domain>
Nov 30 10:50:49 user nova-compute[75020]:  {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 10:50:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Successfully detached device tap7b01937f-97 from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf from the persistent domain config.
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] (1/8): Attempting to detach device tap7b01937f-97 with device alias net1 from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] detach device xml: <interface type="ethernet">
Nov 30 10:50:49 user nova-compute[75020]:   <mac address="fa:16:3e:0b:ad:9c"/>
Nov 30 10:50:49 user nova-compute[75020]:   <model type="virtio"/>
Nov 30 10:50:49 user nova-compute[75020]:   <mtu size="1442"/>
Nov 30 10:50:49 user nova-compute[75020]:   <target dev="tap7b01937f-97"/>
Nov 30 10:50:49 user nova-compute[75020]: </interface>
Nov 30 10:50:49 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgNetlcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:49 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b15791-0e9f-46fd-9009-6b69b9216837]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:50:49 user nova-compute[75020]: No targets found.
Nov 30 10:50:49 user nova-compute[75020]: iSNS:
Nov 30 10:50:49 user nova-compute[75020]: No targets found.
Nov 30 10:50:49 user nova-compute[75020]: STATIC:
Nov 30 10:50:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44
Nov 30 10:50:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c
Nov 30 10:50:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8
Nov 30 10:50:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:50:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be
Nov 30 10:50:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:50:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6
Nov 30 10:50:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:49 user nova-compute[75020]: FIRMWARE:
Nov 30 10:50:49 user nova-compute[75020]: No targets found.
Nov 30 10:50:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:50:49 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:50:49 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f060ab-60fe-42b3-b508-79e367d5704b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8719b-8c67-4120-aef7-7e730fc0c6fd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:49 user nova-compute[75020]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 (non-flash)
Nov 30 10:50:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada815b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44'): ({'sdh'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Removing single pathed devices sdh {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Start waiting for the detach event from libvirt for device tap7b01937f-97 with device alias net1 for instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b1447-77d2-4d41-9bb5-caa8a549ec10]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[469a5588-013a-4535-bb02-5372d4e55c76]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Flushing IO for device /dev/sdh {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0f06d9-1dc3-4dd3-ac03-2ed67101f8a1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e933909-a5c9-4a8b-b52c-ad11b09b633a]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] SCSI volumes sdh have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[901ede6d-cafb-449d-829d-f3ad920ea018]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-ff717985-56d5-4b34-bdc2-013d712d740d req-67daed2b-d6db-4fd9-9e63-1e6e8d9af6cf service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-unplugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ff717985-56d5-4b34-bdc2-013d712d740d req-67daed2b-d6db-4fd9-9e63-1e6e8d9af6cf service nova] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ff717985-56d5-4b34-bdc2-013d712d740d req-67daed2b-d6db-4fd9-9e63-1e6e8d9af6cf service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ff717985-56d5-4b34-bdc2-013d712d740d req-67daed2b-d6db-4fd9-9e63-1e6e8d9af6cf service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-ff717985-56d5-4b34-bdc2-013d712d740d req-67daed2b-d6db-4fd9-9e63-1e6e8d9af6cf service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] No waiting events found dispatching network-vif-unplugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:49 user nova-compute[75020]: WARNING nova.compute.manager [req-ff717985-56d5-4b34-bdc2-013d712d740d req-67daed2b-d6db-4fd9-9e63-1e6e8d9af6cf service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received unexpected event network-vif-unplugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf for instance with vm_state active and task_state None.
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a484ba2-f950-4189-ad2d-7a91e26a5fea]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44, portal: 172.16.0.220,3260]
Nov 30 10:50:49 user nova-compute[75020]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ce2c33-7e7a-40ae-8565-4092f5421a44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf69ee49-adb9-480f-8704-4d08e71358f1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] <== disconnect_volume: return (350ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dukOrZFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '77a73463-ea12-43c3-83a4-803f4a535010', 'attached_at': '', 'detached_at': '', 'volume_id': '77ca61d2-17b6-4840-9967-47da7e0ac5de', 'serial'} {{(pid=75020) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 10:50:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] swap_volume: removing Cinder connection for volume 28ce2c33-7e7a-40ae-8565-4092f5421a44 {{(pid=75020) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-737bc039-5cc3-4d24-8e56-1e609e876c8a req-76430c2f-7659-4467-a25f-2d16fe18fbdd service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-changed-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-737bc039-5cc3-4d24-8e56-1e609e876c8a req-76430c2f-7659-4467-a25f-2d16fe18fbdd service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing instance network info cache due to event network-changed-6d05c95f-4b7a-4397-a4a2-0940c89403d7. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-737bc039-5cc3-4d24-8e56-1e609e876c8a req-76430c2f-7659-4467-a25f-2d16fe18fbdd service nova] Acquiring lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-737bc039-5cc3-4d24-8e56-1e609e876c8a req-76430c2f-7659-4467-a25f-2d16fe18fbdd service nova] Acquired lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-737bc039-5cc3-4d24-8e56-1e609e876c8a req-76430c2f-7659-4467-a25f-2d16fe18fbdd service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Refreshing network info cache for port 6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG os_brick.utils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf1c8d-0c41-4c73-87b0-f6c7d3e26509]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265fb4f-b58b-4bb9-9488-ad587dc2f11e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[617cdb5e-3227-4873-b5e5-86c33c3852cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2393156-976d-41c7-991a-33c1eb5b744c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:50 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d298e484-c4d1-4538-9d11-2b394387168d]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG os_brick.utils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating existing volume attachment record: c1b55f71-0808-4c96-a23a-c652e39e8a8a {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-737bc039-5cc3-4d24-8e56-1e609e876c8a req-76430c2f-7659-4467-a25f-2d16fe18fbdd service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updated VIF entry in instance network info cache for port 6d05c95f-4b7a-4397-a4a2-0940c89403d7. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-737bc039-5cc3-4d24-8e56-1e609e876c8a req-76430c2f-7659-4467-a25f-2d16fe18fbdd service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-737bc039-5cc3-4d24-8e56-1e609e876c8a req-76430c2f-7659-4467-a25f-2d16fe18fbdd service nova] Releasing lock "refresh_cache-a9ad945a-9ce1-4d42-888c-18e660b9d67c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:50:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-704608bb-9352-4f4b-b257-216c4fc6b548 req-a94e90fc-4580-4824-b2ca-39d878848cc6 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-704608bb-9352-4f4b-b257-216c4fc6b548 req-a94e90fc-4580-4824-b2ca-39d878848cc6 service nova] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-704608bb-9352-4f4b-b257-216c4fc6b548 req-a94e90fc-4580-4824-b2ca-39d878848cc6 service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-704608bb-9352-4f4b-b257-216c4fc6b548 req-a94e90fc-4580-4824-b2ca-39d878848cc6 service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-704608bb-9352-4f4b-b257-216c4fc6b548 req-a94e90fc-4580-4824-b2ca-39d878848cc6 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] No waiting events found dispatching network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:51 user nova-compute[75020]: WARNING nova.compute.manager [req-704608bb-9352-4f4b-b257-216c4fc6b548 req-a94e90fc-4580-4824-b2ca-39d878848cc6 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received unexpected event network-vif-plugged-7b01937f-97ba-45f8-bbb3-cd0bad2453bf for instance with vm_state active and task_state None.
Nov 30 10:50:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:52 user nova-compute[75020]: INFO nova.compute.manager [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Terminating instance
Nov 30 10:50:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG nova.objects.instance [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lazy-loading 'flavor' on Instance uuid 77f4c5de-b6dd-486f-b121-47a08de231a9 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10d01c26-9752-4ca6-a8f5-d29142b51a61 tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.048s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-8abea026-0235-4ba4-8b5c-a4acccaf5fe4 req-ed07de4e-1c04-4504-a6ad-7140dbefbfdd service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8abea026-0235-4ba4-8b5c-a4acccaf5fe4 req-ed07de4e-1c04-4504-a6ad-7140dbefbfdd service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8abea026-0235-4ba4-8b5c-a4acccaf5fe4 req-ed07de4e-1c04-4504-a6ad-7140dbefbfdd service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8abea026-0235-4ba4-8b5c-a4acccaf5fe4 req-ed07de4e-1c04-4504-a6ad-7140dbefbfdd service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-8abea026-0235-4ba4-8b5c-a4acccaf5fe4 req-ed07de4e-1c04-4504-a6ad-7140dbefbfdd service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-unplugged-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-8abea026-0235-4ba4-8b5c-a4acccaf5fe4 req-ed07de4e-1c04-4504-a6ad-7140dbefbfdd service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-15aee499-aa82-456a-832e-217fe9dd590e for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] swap_volume: Updating volume 28ce2c33-7e7a-40ae-8565-4092f5421a44 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dukOrZFo", "auth_password": "owUYXuv7lIEtLb", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "77ca61d2-17b6-4840-9967-47da7e0ac5de"}, "status": "reserved", "instance": "77a73463-ea12-43c3-83a4-803f4a535010", "attached_at": "", "detached_at": "", "volume_id": "77ca61d2-17b6-4840-9967-47da7e0ac5de", "serial": "77ca61d2-17b6-4840-9967-47da7e0ac5de"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '77ca61d2-17b6-4840-9967-47da7e0ac5de', 'no_device': None, 'attachment_id': '0b2e304c-0bca-4968-9f36-abb27c99d9ec'} {{(pid=75020) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-056bb3f5-5581-4507-9903-3f8ff48c5811 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "77a73463-ea12-43c3-83a4-803f4a535010" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 27.597s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:53 user nova-compute[75020]: INFO nova.compute.manager [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Terminating instance
Nov 30 10:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-544a18c5-852b-49e1-9b6b-4f28a664986d req-1fd2c4b5-32e2-4d1b-885c-51670931e2e0 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-544a18c5-852b-49e1-9b6b-4f28a664986d req-1fd2c4b5-32e2-4d1b-885c-51670931e2e0 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-544a18c5-852b-49e1-9b6b-4f28a664986d req-1fd2c4b5-32e2-4d1b-885c-51670931e2e0 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-544a18c5-852b-49e1-9b6b-4f28a664986d req-1fd2c4b5-32e2-4d1b-885c-51670931e2e0 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-544a18c5-852b-49e1-9b6b-4f28a664986d req-1fd2c4b5-32e2-4d1b-885c-51670931e2e0 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-unplugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-544a18c5-852b-49e1-9b6b-4f28a664986d req-1fd2c4b5-32e2-4d1b-885c-51670931e2e0 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-a1727f1f-8a30-4ee9-863c-370e58b80627 req-6ab4546e-8963-4ad0-854b-e03fec21e5e8 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a1727f1f-8a30-4ee9-863c-370e58b80627 req-6ab4546e-8963-4ad0-854b-e03fec21e5e8 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a1727f1f-8a30-4ee9-863c-370e58b80627 req-6ab4546e-8963-4ad0-854b-e03fec21e5e8 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a1727f1f-8a30-4ee9-863c-370e58b80627 req-6ab4546e-8963-4ad0-854b-e03fec21e5e8 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-a1727f1f-8a30-4ee9-863c-370e58b80627 req-6ab4546e-8963-4ad0-854b-e03fec21e5e8 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-unplugged-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-a1727f1f-8a30-4ee9-863c-370e58b80627 req-6ab4546e-8963-4ad0-854b-e03fec21e5e8 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-7a9ded10-59fc-429b-a08c-cb8282d20238 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:54 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Instance destroyed successfully.
Nov 30 10:50:54 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lazy-loading 'resources' on Instance uuid 77f4c5de-b6dd-486f-b121-47a08de231a9 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1430822462',display_name='tempest-AttachSCSIVolumeTestJSON-server-1430822462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1430822462',id=8,image_ref='309f6f84-3967-469f-8f2f-95f9d4deed67',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUPjzBzXOz/It6HliXZQj/rzwF2kTEuocy5ZSlrKoe8g+I+k/V3scQBxR3SMkBIIDTfqJMVCcrJOeKPh8ihPL7JalwO4CsaYn4hdZ0yNLx+nKrpmb74zvy2VuyShU280A==',key_name='tempest-keypair-272548173',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd909ba3afb5482ab3d20c7d56c7c4a0',ramdisk_id='',reservation_id='r-ljae1e01',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='309f6f84-3967-469f-8f2f-95f9d4deed67',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-915997186',owner_user_name='tempest-AttachSCSIVolumeTestJSON-915997186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f3745f257ba49c4b4de2e51d2d8ec22',uuid=77f4c5de-b6dd-486f-b121-47a08de231a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Converting VIF {"id": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "address": "fa:16:3e:e3:14:e7", "network": {"id": "dee6d234-8b41-4ca8-a56d-5eee68069d6a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-682100967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd909ba3afb5482ab3d20c7d56c7c4a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ddd1a8f-43", "ovs_interfaceid": "4ddd1a8f-43f5-4086-8c5f-8bb79c31e355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:14:e7,bridge_name='br-int',has_traffic_filtering=True,id=4ddd1a8f-43f5-4086-8c5f-8bb79c31e355,network=Network(dee6d234-8b41-4ca8-a56d-5eee68069d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ddd1a8f-43') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_vif [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:14:e7,bridge_name='br-int',has_traffic_filtering=True,id=4ddd1a8f-43f5-4086-8c5f-8bb79c31e355,network=Network(dee6d234-8b41-4ca8-a56d-5eee68069d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ddd1a8f-43') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ddd1a8f-43, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "77a73463-ea12-43c3-83a4-803f4a535010" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Instance destroyed successfully.
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lazy-loading 'resources' on Instance uuid a9ad945a-9ce1-4d42-888c-18e660b9d67c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_brick.utils [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d05c95f-4b7a-4397-a4a2-0940c89403d7,network=Network(137e30f8-3d94-4216-b53e-47ecc1bed798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05c95f-4b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d05c95f-4b7a-4397-a4a2-0940c89403d7,network=Network(137e30f8-3d94-4216-b53e-47ecc1bed798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05c95f-4b') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51023c2-b104-4274-8078-51505b53b3dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[25947912-4155-483c-a6f6-3c9e29b8f038]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc285550-7080-456d-9c11-7b5e399bde49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d05c95f-4b, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ff719-335d-4859-ab6c-34d2dca187c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:50:55 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c0d5b8-dba2-4236-bdbf-03a3d95ece29]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_brick.utils [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bab12059-fa47-4ffd-bce9-9e40508cc3cd) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: INFO nova.compute.manager [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Swapping volume 77ca61d2-17b6-4840-9967-47da7e0ac5de for 28ce2c33-7e7a-40ae-8565-4092f5421a44
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2914a4d0-2ac2-42fb-ae57-695b7dc5853a) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: INFO os_vif [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:14:e7,bridge_name='br-int',has_traffic_filtering=True,id=4ddd1a8f-43f5-4086-8c5f-8bb79c31e355,network=Network(dee6d234-8b41-4ca8-a56d-5eee68069d6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ddd1a8f-43')
Nov 30 10:50:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Deleting instance files /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9_del
Nov 30 10:50:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Deletion of /opt/stack/data/nova/instances/77f4c5de-b6dd-486f-b121-47a08de231a9_del complete
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:55 user nova-compute[75020]: WARNING nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-15aee499-aa82-456a-832e-217fe9dd590e for instance with vm_state active and task_state deleting.
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-unplugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:55 user nova-compute[75020]: WARNING nova.compute.manager [req-53015b0d-0593-495d-98ef-ab0944e5afc2 req-d0843567-d122-4b72-9523-1ca13cc38280 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 for instance with vm_state active and task_state deleting.
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: INFO os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=6d05c95f-4b7a-4397-a4a2-0940c89403d7,network=Network(137e30f8-3d94-4216-b53e-47ecc1bed798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05c95f-4b')
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:78:ed,bridge_name='br-int',has_traffic_filtering=True,id=15aee499-aa82-456a-832e-217fe9dd590e,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15aee499-aa') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:78:ed,bridge_name='br-int',has_traffic_filtering=True,id=15aee499-aa82-456a-832e-217fe9dd590e,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15aee499-aa') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15aee499-aa, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: INFO nova.compute.manager [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Took 1.92 seconds to destroy the instance on the hypervisor.
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8487040-c046-4ef0-834f-dd7bdd3fff3b) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: INFO os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:78:ed,bridge_name='br-int',has_traffic_filtering=True,id=15aee499-aa82-456a-832e-217fe9dd590e,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15aee499-aa')
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:22,bridge_name='br-int',has_traffic_filtering=True,id=db40c00e-b7c2-42a8-9010-2bb48467c1fb,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb40c00e-b7') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:22,bridge_name='br-int',has_traffic_filtering=True,id=db40c00e-b7c2-42a8-9010-2bb48467c1fb,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb40c00e-b7') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb40c00e-b7, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=419977d4-bc09-480f-9c45-e39f59b5d2ef) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: INFO os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:22,bridge_name='br-int',has_traffic_filtering=True,id=db40c00e-b7c2-42a8-9010-2bb48467c1fb,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb40c00e-b7')
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=0345f742-a081-4244-b874-54667cd790dd,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0345f742-a0') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=0345f742-a081-4244-b874-54667cd790dd,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0345f742-a0') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0345f742-a0, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c8780eb-152f-4b81-9e5c-751ef346fe66) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:55 user nova-compute[75020]: WARNING nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-6d05c95f-4b7a-4397-a4a2-0940c89403d7 for instance with vm_state active and task_state deleting.
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-unplugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:55 user nova-compute[75020]: WARNING nova.compute.manager [req-5dba6a7d-6288-4ff1-8416-dedd9be0cfd5 req-3b6f70eb-dc09-432a-b378-dce9c1be7f4f service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-db40c00e-b7c2-42a8-9010-2bb48467c1fb for instance with vm_state active and task_state deleting.
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: INFO os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b8:3f,bridge_name='br-int',has_traffic_filtering=True,id=0345f742-a081-4244-b874-54667cd790dd,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0345f742-a0')
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:de,bridge_name='br-int',has_traffic_filtering=True,id=fa7b73e3-b623-474f-a636-164d67d9029d,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b73e3-b6') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:de,bridge_name='br-int',has_traffic_filtering=True,id=fa7b73e3-b623-474f-a636-164d67d9029d,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b73e3-b6') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa7b73e3-b6, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dff66f9-61c1-462f-b69f-0539a90bfea0) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: INFO os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b7:de,bridge_name='br-int',has_traffic_filtering=True,id=fa7b73e3-b623-474f-a636-164d67d9029d,network=Network(99677362-1e44-4138-84b3-235b91329a8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b73e3-b6')
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=7a9ded10-59fc-429b-a08c-cb8282d20238,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ded10-59') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=7a9ded10-59fc-429b-a08c-cb8282d20238,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ded10-59') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a9ded10-59, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2977883-3edb-450a-8af4-0a898600aff5) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: INFO os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=7a9ded10-59fc-429b-a08c-cb8282d20238,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ded10-59')
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801034793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-801034793',id=11,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpz/Nf4/Ohnu7j869S6d3UyCBdG1Ksv7HVI8OJqJcL3m7J4UODoZMteJ+M1hoFFl711ZRDSd96OTkjf+kY9yoIpfLL2Hyk9SQd3aDsOmCD9InxF5RARQAbSb5is0xdrIQ==',key_name='tempest-keypair-1597946199',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17f5aac1ca93428ca3e43a1f79fd832a',ramdisk_id='',reservation_id='r-h40rpafx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1465260125',owner_user_name='tempest-TaggedBootDevicesTest_v242-1465260125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98bf8422cf74974bd47a93336341358',uuid=a9ad945a-9ce1-4d42-888c-18e660b9d67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converting VIF {"id": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "address": "fa:16:3e:47:6d:c8", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72d127f-f4", "ovs_interfaceid": "e72d127f-f4ce-4595-9cb8-f30e6ebed2d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6d:c8,bridge_name='br-int',has_traffic_filtering=True,id=e72d127f-f4ce-4595-9cb8-f30e6ebed2d7,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72d127f-f4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6d:c8,bridge_name='br-int',has_traffic_filtering=True,id=e72d127f-f4ce-4595-9cb8-f30e6ebed2d7,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72d127f-f4') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape72d127f-f4, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0936f1a7-25cd-45af-9007-0699340a8483) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:56 user nova-compute[75020]: WARNING nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-7a9ded10-59fc-429b-a08c-cb8282d20238 for instance with vm_state active and task_state deleting.
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received event network-vif-unplugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] No waiting events found dispatching network-vif-unplugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received event network-vif-unplugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received event network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Acquiring lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] No waiting events found dispatching network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:56 user nova-compute[75020]: WARNING nova.compute.manager [req-b445b70e-1d72-4c40-bb49-4b905fad2826 req-dcce1835-356d-42ad-9e8f-37effc75d676 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received unexpected event network-vif-plugged-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 for instance with vm_state active and task_state deleting.
Nov 30 10:50:56 user nova-compute[75020]: INFO os_vif [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6d:c8,bridge_name='br-int',has_traffic_filtering=True,id=e72d127f-f4ce-4595-9cb8-f30e6ebed2d7,network=Network(4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72d127f-f4')
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GbVZWFuI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:56 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3c36d9-64be-41cf-b4c3-b7d34c531003]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]: iSNS:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]: STATIC:
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: FIRMWARE:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:50:56 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:50:56 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc58d9a5-c987-4ee2-b364-7c5bf9f33b9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abe8414-7a6e-42b0-b8fb-0e2716061700]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad887d75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f58db25-f6a3-4c1b-a5cc-0affdbfb20cf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3e8bc6-33d0-4f0f-a291-00bc3cce0a92]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc548c08-2aa4-46a5-968a-33f546f2ed01]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcf49d3-bda3-4022-ade5-16359431fcf5]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c45cd71-1024-457a-a632-26f982aef7fe]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27201c8-d81c-46ee-a868-8dadaebc9972]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6, portal: 172.16.0.220,3260]
Nov 30 10:50:56 user nova-compute[75020]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c485241a-d3ce-4f5f-8e36-c5097afa4bb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6169af8b-e1ca-4efc-97e9-d1e464eecbf5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== disconnect_volume: return (345ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzpGUqAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:56 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcec961-0e35-41e7-a778-2c7c137e3aaf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]: iSNS:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]: STATIC:
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: FIRMWARE:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:50:56 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:50:56 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cdc7e5-37a5-4284-94f3-70e947a99d24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[51860a91-4a44-4e74-8ff2-e746e944654f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada815af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9371de-a151-451a-a102-5f9690a88ba4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e968e528-5ada-4a43-9f37-853e574de2fe]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97fdd47-320d-429d-b01d-c167b74a01da]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f239e2-1e0d-44f4-b3e4-00f69bdda60f]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0cdfab-5042-4f38-8101-3410069b2f53]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10e10c9-9727-43bb-a645-fe3d84b2eb1a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be, portal: 172.16.0.220,3260]
Nov 30 10:50:56 user nova-compute[75020]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eabfdc11-d002-41bc-b708-dbb60ba404be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e05df0-cda3-4e6c-ad57-cd121033fe92]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== disconnect_volume: return (326ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJEhjyWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:50:56 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20ff64e-e422-4fe8-86d7-055e7fac9652]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]: iSNS:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]: STATIC:
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:50:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:50:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:50:56 user nova-compute[75020]: FIRMWARE:
Nov 30 10:50:56 user nova-compute[75020]: No targets found.
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:50:56 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:50:56 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c506c6-f9a1-42a2-a321-bf9a6ddd7835]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7a9b1a-14d7-4ac2-92f0-634156679b0d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c (non-flash)
Nov 30 10:50:56 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:50:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada815af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c'): ({'sdd'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Removing single pathed devices sdd {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5de8d8b-1c41-4ae7-b6e5-6f1d4676695d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cce3771-ab4a-4a0f-b324-e4224db662fc]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Flushing IO for device /dev/sdd {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[50981548-52a6-4570-8306-4bf888d95998]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe5b31-2fa3-4003-bfbf-869a14d8bb5f]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d741a7-3b78-43fa-aea2-2becdbe31b44]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d8a4d7-e6d0-4814-819b-83e99d594ff2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c, portal: 172.16.0.220,3260]
Nov 30 10:50:57 user nova-compute[75020]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c, portal: 172.16.0.220,3260] successful.
Nov 30 10:50:57 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363f5d5c-f690-4f66-b660-b5a25009605c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cb3647-b3d2-4260-b0e0-2ecc4238ca6a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] <== disconnect_volume: return (359ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:50:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Deleting instance files /opt/stack/data/nova/instances/a9ad945a-9ce1-4d42-888c-18e660b9d67c_del
Nov 30 10:50:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Deletion of /opt/stack/data/nova/instances/a9ad945a-9ce1-4d42-888c-18e660b9d67c_del complete
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:50:57 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Took 1.71 seconds to deallocate network for instance.
Nov 30 10:50:57 user nova-compute[75020]: INFO nova.compute.manager [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Took 4.49 seconds to destroy the instance on the hypervisor.
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:57 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Deleted allocations for instance 77f4c5de-b6dd-486f-b121-47a08de231a9
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d4c98988-44f7-4d76-bcdb-d0a6f09d4d1b tempest-AttachSCSIVolumeTestJSON-915997186 tempest-AttachSCSIVolumeTestJSON-915997186-project-member] Lock "77f4c5de-b6dd-486f-b121-47a08de231a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.295s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-unplugged-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-0345f742-a081-4244-b874-54667cd790dd for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:57 user nova-compute[75020]: WARNING nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-0345f742-a081-4244-b874-54667cd790dd for instance with vm_state active and task_state deleting.
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-unplugged-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-unplugged-fa7b73e3-b623-474f-a636-164d67d9029d for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: 77f4c5de-b6dd-486f-b121-47a08de231a9] Received event network-vif-deleted-4ddd1a8f-43f5-4086-8c5f-8bb79c31e355 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Acquiring lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:50:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] No waiting events found dispatching network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:50:57 user nova-compute[75020]: WARNING nova.compute.manager [req-8098c2cb-30ab-4bf6-8d97-f1ccdd37266d req-4eb18049-d509-4120-81cd-3aa68f7fe545 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received unexpected event network-vif-plugged-fa7b73e3-b623-474f-a636-164d67d9029d for instance with vm_state active and task_state deleting.
Nov 30 10:50:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:50:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-deleted-e72d127f-f4ce-4595-9cb8-f30e6ebed2d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:00 user nova-compute[75020]: INFO nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Neutron deleted interface e72d127f-f4ce-4595-9cb8-f30e6ebed2d7; detaching it from the instance and deleting it from the info cache
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.network.neutron [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a9ded10-59fc-429b-a08c-cb8282d20238", "address": "fa:16:3e:d8:bc:68", "network": {"id": "4c6afcc1-d1e6-4457-b1a7-9bec5acc7bdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1625668001", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ded10-59", "ovs_interfaceid": "7a9ded10-59fc-429b-a08c-cb8282d20238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Detach interface failed, port_id=e72d127f-f4ce-4595-9cb8-f30e6ebed2d7, reason: Instance a9ad945a-9ce1-4d42-888c-18e660b9d67c could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-deleted-7a9ded10-59fc-429b-a08c-cb8282d20238 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:00 user nova-compute[75020]: INFO nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Neutron deleted interface 7a9ded10-59fc-429b-a08c-cb8282d20238; detaching it from the instance and deleting it from the info cache
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.network.neutron [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0345f742-a081-4244-b874-54667cd790dd", "address": "fa:16:3e:03:b8:3f", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0345f742-a0", "ovs_interfaceid": "0345f742-a081-4244-b874-54667cd790dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Detach interface failed, port_id=7a9ded10-59fc-429b-a08c-cb8282d20238, reason: Instance a9ad945a-9ce1-4d42-888c-18e660b9d67c could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-deleted-0345f742-a081-4244-b874-54667cd790dd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:00 user nova-compute[75020]: INFO nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Neutron deleted interface 0345f742-a081-4244-b874-54667cd790dd; detaching it from the instance and deleting it from the info cache
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.network.neutron [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [{"id": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "address": "fa:16:3e:28:ab:b9", "network": {"id": "137e30f8-3d94-4216-b53e-47ecc1bed798", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1185102515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05c95f-4b", "ovs_interfaceid": "6d05c95f-4b7a-4397-a4a2-0940c89403d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15aee499-aa82-456a-832e-217fe9dd590e", "address": "fa:16:3e:e3:78:ed", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15aee499-aa", "ovs_interfaceid": "15aee499-aa82-456a-832e-217fe9dd590e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "address": "fa:16:3e:80:ff:22", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb40c00e-b7", "ovs_interfaceid": "db40c00e-b7c2-42a8-9010-2bb48467c1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa7b73e3-b623-474f-a636-164d67d9029d", "address": "fa:16:3e:e1:b7:de", "network": {"id": "99677362-1e44-4138-84b3-235b91329a8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-674724199", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "17f5aac1ca93428ca3e43a1f79fd832a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b73e3-b6", "ovs_interfaceid": "fa7b73e3-b623-474f-a636-164d67d9029d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-ae1f56e1-35b9-4dcb-930f-b21ff6b7baab req-757451d0-35d2-4a0a-9dca-06707b7e069e service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Detach interface failed, port_id=0345f742-a081-4244-b874-54667cd790dd, reason: Instance a9ad945a-9ce1-4d42-888c-18e660b9d67c could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:00 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Took 3.45 seconds to deallocate network for instance.
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:51:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Creating image(s)
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Ensure instance console log exists: /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Start _get_guest_xml network_info=[{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'c1b55f71-0808-4c96-a23a-c652e39e8a8a', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqvIyoft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9768f14b-9e34-421e-be7c-e541442814e4', 'attached_at': '', 'detached_at': '', 'volume_id': '42207515-31c1-47d2-8265-2c940db06482', 'serial': '42207515-31c1-47d2-8265-2c940db06482'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:51:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:51:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqvIyoft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:51:01 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:51:01 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:51:01 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06fb1cf-6b73-41bc-9f70-62edb73cb0a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:51:01 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9993be-d035-47fc-8203-70d9506bf069]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482] added
Nov 30 10:51:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[69868438-0b5e-47a6-81cf-3d9bb1e9d9de]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c394d14-be28-4bba-b9d8-249f77899e5c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqvIyoft {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqvIyoft" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19d7be1-3ebf-4730-af5d-1d23cc804eb9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JqvIyoft'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb7bf0-2632-436d-9d99-71202e1f13a5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9db70ff-7287-46f4-ac6e-fa962da562bd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1202bf-6daf-47e0-af93-53835f9e1a55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482, portal: 172.16.0.220,3260]
Nov 30 10:51:01 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482, portal: 172.16.0.220,3260] successful.
Nov 30 10:51:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1e7815-58cf-4cd9-90bc-1d17de2e8d3a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[422e8e1b-b37d-4d58-9f8f-f480e523a8f8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c833cc-622b-4eb7-a3d2-6752052fdb73]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:51:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqvIyoft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-68f92137-e68d-43ab-9b23-366f36e01ea8 req-b7f13e47-db86-414a-8329-d9b9327ef231 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-deleted-6d05c95f-4b7a-4397-a4a2-0940c89403d7 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-68f92137-e68d-43ab-9b23-366f36e01ea8 req-b7f13e47-db86-414a-8329-d9b9327ef231 service nova] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Received event network-vif-deleted-fa7b73e3-b623-474f-a636-164d67d9029d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26235653339356363', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235653339356363', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-533945810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-533945810',id=13,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-po0avutn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:50:44Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=9768f14b-9e34-421e-be7c-e541442814e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8a:24,bridge_name='br-int',has_traffic_filtering=True,id=e6d72d13-bbe8-4450-ab51-a898223e1ca2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d72d13-bb') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'pci_devices' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:51:02 user nova-compute[75020]:   <uuid>9768f14b-9e34-421e-be7c-e541442814e4</uuid>
Nov 30 10:51:02 user nova-compute[75020]:   <name>instance-0000000d</name>
Nov 30 10:51:02 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:51:02 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:51:02 user nova-compute[75020]:   <metadata>
Nov 30 10:51:02 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:02 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:51:02 user nova-compute[75020]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-533945810</nova:name>
Nov 30 10:51:02 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:51:00</nova:creationTime>
Nov 30 10:51:02 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:51:02 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:51:02 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:51:02 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:51:02 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:02 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:02 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:51:02 user nova-compute[75020]:       <nova:owner>
Nov 30 10:51:02 user nova-compute[75020]:         <nova:user uuid="a93ae25dec664c44ba88b0f15f6a239e">tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member</nova:user>
Nov 30 10:51:02 user nova-compute[75020]:         <nova:project uuid="e02acda28c914dcdaa8afa65411b8055">tempest-ServerBootFromVolumeStableRescueTest-548019548</nova:project>
Nov 30 10:51:02 user nova-compute[75020]:       </nova:owner>
Nov 30 10:51:02 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:02 user nova-compute[75020]:       <nova:ports>
Nov 30 10:51:02 user nova-compute[75020]:         <nova:port uuid="e6d72d13-bbe8-4450-ab51-a898223e1ca2">
Nov 30 10:51:02 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 10:51:02 user nova-compute[75020]:         </nova:port>
Nov 30 10:51:02 user nova-compute[75020]:       </nova:ports>
Nov 30 10:51:02 user nova-compute[75020]:     </nova:instance>
Nov 30 10:51:02 user nova-compute[75020]:   </metadata>
Nov 30 10:51:02 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:51:02 user nova-compute[75020]:     <system>
Nov 30 10:51:02 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:51:02 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:51:02 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:51:02 user nova-compute[75020]:       <entry name="serial">9768f14b-9e34-421e-be7c-e541442814e4</entry>
Nov 30 10:51:02 user nova-compute[75020]:       <entry name="uuid">9768f14b-9e34-421e-be7c-e541442814e4</entry>
Nov 30 10:51:02 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:51:02 user nova-compute[75020]:     </system>
Nov 30 10:51:02 user nova-compute[75020]:   </sysinfo>
Nov 30 10:51:02 user nova-compute[75020]:   <os>
Nov 30 10:51:02 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:51:02 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:51:02 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:51:02 user nova-compute[75020]:   </os>
Nov 30 10:51:02 user nova-compute[75020]:   <features>
Nov 30 10:51:02 user nova-compute[75020]:     <acpi/>
Nov 30 10:51:02 user nova-compute[75020]:     <apic/>
Nov 30 10:51:02 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:51:02 user nova-compute[75020]:   </features>
Nov 30 10:51:02 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:51:02 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:51:02 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:51:02 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:51:02 user nova-compute[75020]:   </clock>
Nov 30 10:51:02 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:51:02 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:51:02 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:51:02 user nova-compute[75020]:   </cpu>
Nov 30 10:51:02 user nova-compute[75020]:   <devices>
Nov 30 10:51:02 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:51:02 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:51:02 user nova-compute[75020]:       <source dev="/dev/sdb"/>
Nov 30 10:51:02 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:51:02 user nova-compute[75020]:       <serial>42207515-31c1-47d2-8265-2c940db06482</serial>
Nov 30 10:51:02 user nova-compute[75020]:     </disk>
Nov 30 10:51:02 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:51:02 user nova-compute[75020]:       <mac address="fa:16:3e:83:8a:24"/>
Nov 30 10:51:02 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:02 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:51:02 user nova-compute[75020]:       <target dev="tape6d72d13-bb"/>
Nov 30 10:51:02 user nova-compute[75020]:     </interface>
Nov 30 10:51:02 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:51:02 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/console.log" append="off"/>
Nov 30 10:51:02 user nova-compute[75020]:     </serial>
Nov 30 10:51:02 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:51:02 user nova-compute[75020]:     <video>
Nov 30 10:51:02 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:02 user nova-compute[75020]:     </video>
Nov 30 10:51:02 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:51:02 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:51:02 user nova-compute[75020]:     </rng>
Nov 30 10:51:02 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:51:02 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:51:02 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:51:02 user nova-compute[75020]:     </memballoon>
Nov 30 10:51:02 user nova-compute[75020]:   </devices>
Nov 30 10:51:02 user nova-compute[75020]: </domain>
Nov 30 10:51:02 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-533945810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-533945810',id=13,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-po0avutn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:50:44Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=9768f14b-9e34-421e-be7c-e541442814e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8a:24,bridge_name='br-int',has_traffic_filtering=True,id=e6d72d13-bbe8-4450-ab51-a898223e1ca2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d72d13-bb') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG os_vif [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8a:24,bridge_name='br-int',has_traffic_filtering=True,id=e6d72d13-bbe8-4450-ab51-a898223e1ca2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d72d13-bb') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9751c8f6-9c7b-5286-bbc9-e6d34da32aaf', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6d72d13-bb, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6d72d13-bb, col_values=(('qos', UUID('efc5540f-30ce-4fa4-807c-42e4ead57bdf')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6d72d13-bb, col_values=(('external_ids', {'iface-id': 'e6d72d13-bbe8-4450-ab51-a898223e1ca2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:8a:24', 'vm-uuid': '9768f14b-9e34-421e-be7c-e541442814e4'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:02 user nova-compute[75020]: INFO os_vif [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8a:24,bridge_name='br-int',has_traffic_filtering=True,id=e6d72d13-bbe8-4450-ab51-a898223e1ca2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d72d13-bb')
Nov 30 10:51:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No VIF found with MAC fa:16:3e:83:8a:24, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:02 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:51:02 user nova-compute[75020]: INFO nova.compute.claims [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Claim successful on node user
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.volume.cinder [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Update attachment failed for attachment ecc7129d-d0c2-458f-856d-31f3502a082c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab74be49-5af4-4ac2-a556-0336544cab36) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab74be49-5af4-4ac2-a556-0336544cab36)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Failed to connect to volume 28ce2c33-7e7a-40ae-8565-4092f5421a44 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab74be49-5af4-4ac2-a556-0336544cab36)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Traceback (most recent call last):
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     new_cinfo = self.volume_api.attachment_update(
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     res = method(self, ctx, *args, **kwargs)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     with excutils.save_and_reraise_exception():
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     self.force_reraise()
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     raise self.value
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     context, '3.44', skip_version_check=True).attachments.update(
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     return method.func(obj, *args, **kwargs)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     resp = self._update('/attachments/%s' % id, body)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     return self._cs_request(url, 'PUT', **kwargs)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     return self.request(url, method, **kwargs)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010]     raise exceptions.from_response(resp, body)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab74be49-5af4-4ac2-a556-0336544cab36)
Nov 30 10:51:02 user nova-compute[75020]: ERROR nova.compute.manager [instance: 77a73463-ea12-43c3-83a4-803f4a535010] 
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Lock "77a73463-ea12-43c3-83a4-803f4a535010" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 8.020s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server [None req-b2fc69ce-5590-4c97-8b11-1f66b5d428b8 tempest-TestVolumeSwap-1781376767 tempest-TestVolumeSwap-1781376767-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab74be49-5af4-4ac2-a556-0336544cab36)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ab74be49-5af4-4ac2-a556-0336544cab36)
Nov 30 10:51:03 user nova-compute[75020]: ERROR oslo_messaging.rpc.server 
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:51:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.policy [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0bf43699eca49558d5605f7912dc32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348ee1a2d9e34ce8ad69a57323cbfb45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:51:03 user nova-compute[75020]: INFO nova.compute.manager [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] [instance: a9ad945a-9ce1-4d42-888c-18e660b9d67c] Took 2.63 seconds to detach 3 volumes for instance.
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:51:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Creating image(s)
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "/opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "/opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk 1073741824" returned: 0 in 0.062s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Successfully created port: 80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:03 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:04 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Deleted allocations for instance a9ad945a-9ce1-4d42-888c-18e660b9d67c
Nov 30 10:51:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-96eb6be2-c55f-447f-b8dc-def472d18f6b req-6bdfa657-4ddf-4ebe-8b1f-50af4ce7d441 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-96eb6be2-c55f-447f-b8dc-def472d18f6b req-6bdfa657-4ddf-4ebe-8b1f-50af4ce7d441 service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-96eb6be2-c55f-447f-b8dc-def472d18f6b req-6bdfa657-4ddf-4ebe-8b1f-50af4ce7d441 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-96eb6be2-c55f-447f-b8dc-def472d18f6b req-6bdfa657-4ddf-4ebe-8b1f-50af4ce7d441 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-96eb6be2-c55f-447f-b8dc-def472d18f6b req-6bdfa657-4ddf-4ebe-8b1f-50af4ce7d441 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:04 user nova-compute[75020]: WARNING nova.compute.manager [req-96eb6be2-c55f-447f-b8dc-def472d18f6b req-6bdfa657-4ddf-4ebe-8b1f-50af4ce7d441 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state building and task_state spawning.
Nov 30 10:51:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-290f6615-151b-4477-8260-5117a30db2e6 tempest-TaggedBootDevicesTest_v242-1465260125 tempest-TaggedBootDevicesTest_v242-1465260125-project-member] Lock "a9ad945a-9ce1-4d42-888c-18e660b9d67c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.472s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Cannot resize image /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Ensure instance console log exists: /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Successfully updated port: 80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "refresh_cache-a4614f08-1c9b-4c2c-b541-3cae09a4d61c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquired lock "refresh_cache-a4614f08-1c9b-4c2c-b541-3cae09a4d61c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-9883fa25-7a24-4c68-b0a4-52a713979308 req-ca8e28bd-6f9d-4521-96b4-53aeac7961ce service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received event network-changed-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-9883fa25-7a24-4c68-b0a4-52a713979308 req-ca8e28bd-6f9d-4521-96b4-53aeac7961ce service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Refreshing instance network info cache due to event network-changed-80123461-3b78-4a9a-907b-8cf4b65af84c. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9883fa25-7a24-4c68-b0a4-52a713979308 req-ca8e28bd-6f9d-4521-96b4-53aeac7961ce service nova] Acquiring lock "refresh_cache-a4614f08-1c9b-4c2c-b541-3cae09a4d61c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Updating instance_info_cache with network_info: [{"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Releasing lock "refresh_cache-a4614f08-1c9b-4c2c-b541-3cae09a4d61c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Instance network_info: |[{"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9883fa25-7a24-4c68-b0a4-52a713979308 req-ca8e28bd-6f9d-4521-96b4-53aeac7961ce service nova] Acquired lock "refresh_cache-a4614f08-1c9b-4c2c-b541-3cae09a4d61c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-9883fa25-7a24-4c68-b0a4-52a713979308 req-ca8e28bd-6f9d-4521-96b4-53aeac7961ce service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Refreshing network info cache for port 80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Start _get_guest_xml network_info=[{"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:51:05 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:05 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1654791619',display_name='tempest-VolumesAdminNegativeTest-server-1654791619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1654791619',id=14,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348ee1a2d9e34ce8ad69a57323cbfb45',ramdisk_id='',reservation_id='r-hzuctm9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1613879927',owner_user_name='tempest-VolumesAdminNegativeTest-1613879927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:03Z,user_data=None,user_id='d0bf43699eca49558d5605f7912dc32a',uuid=a4614f08-1c9b-4c2c-b541-3cae09a4d61c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converting VIF {"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:71:db,bridge_name='br-int',has_traffic_filtering=True,id=80123461-3b78-4a9a-907b-8cf4b65af84c,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80123461-3b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.objects.instance [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lazy-loading 'pci_devices' on Instance uuid a4614f08-1c9b-4c2c-b541-3cae09a4d61c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:51:05 user nova-compute[75020]:   <uuid>a4614f08-1c9b-4c2c-b541-3cae09a4d61c</uuid>
Nov 30 10:51:05 user nova-compute[75020]:   <name>instance-0000000e</name>
Nov 30 10:51:05 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:51:05 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:51:05 user nova-compute[75020]:   <metadata>
Nov 30 10:51:05 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:05 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:51:05 user nova-compute[75020]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1654791619</nova:name>
Nov 30 10:51:05 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:51:05</nova:creationTime>
Nov 30 10:51:05 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:51:05 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:51:05 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:51:05 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:51:05 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:05 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:05 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:51:05 user nova-compute[75020]:       <nova:owner>
Nov 30 10:51:05 user nova-compute[75020]:         <nova:user uuid="d0bf43699eca49558d5605f7912dc32a">tempest-VolumesAdminNegativeTest-1613879927-project-member</nova:user>
Nov 30 10:51:05 user nova-compute[75020]:         <nova:project uuid="348ee1a2d9e34ce8ad69a57323cbfb45">tempest-VolumesAdminNegativeTest-1613879927</nova:project>
Nov 30 10:51:05 user nova-compute[75020]:       </nova:owner>
Nov 30 10:51:05 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:05 user nova-compute[75020]:       <nova:ports>
Nov 30 10:51:05 user nova-compute[75020]:         <nova:port uuid="80123461-3b78-4a9a-907b-8cf4b65af84c">
Nov 30 10:51:05 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 10:51:05 user nova-compute[75020]:         </nova:port>
Nov 30 10:51:05 user nova-compute[75020]:       </nova:ports>
Nov 30 10:51:05 user nova-compute[75020]:     </nova:instance>
Nov 30 10:51:05 user nova-compute[75020]:   </metadata>
Nov 30 10:51:05 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:51:05 user nova-compute[75020]:     <system>
Nov 30 10:51:05 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:51:05 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:51:05 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:51:05 user nova-compute[75020]:       <entry name="serial">a4614f08-1c9b-4c2c-b541-3cae09a4d61c</entry>
Nov 30 10:51:05 user nova-compute[75020]:       <entry name="uuid">a4614f08-1c9b-4c2c-b541-3cae09a4d61c</entry>
Nov 30 10:51:05 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:51:05 user nova-compute[75020]:     </system>
Nov 30 10:51:05 user nova-compute[75020]:   </sysinfo>
Nov 30 10:51:05 user nova-compute[75020]:   <os>
Nov 30 10:51:05 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:51:05 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:51:05 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:51:05 user nova-compute[75020]:   </os>
Nov 30 10:51:05 user nova-compute[75020]:   <features>
Nov 30 10:51:05 user nova-compute[75020]:     <acpi/>
Nov 30 10:51:05 user nova-compute[75020]:     <apic/>
Nov 30 10:51:05 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:51:05 user nova-compute[75020]:   </features>
Nov 30 10:51:05 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:51:05 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:51:05 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:51:05 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:51:05 user nova-compute[75020]:   </clock>
Nov 30 10:51:05 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:51:05 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:51:05 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:51:05 user nova-compute[75020]:   </cpu>
Nov 30 10:51:05 user nova-compute[75020]:   <devices>
Nov 30 10:51:05 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:51:05 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:51:05 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk"/>
Nov 30 10:51:05 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:51:05 user nova-compute[75020]:     </disk>
Nov 30 10:51:05 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:51:05 user nova-compute[75020]:       <mac address="fa:16:3e:a2:71:db"/>
Nov 30 10:51:05 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:05 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:51:05 user nova-compute[75020]:       <target dev="tap80123461-3b"/>
Nov 30 10:51:05 user nova-compute[75020]:     </interface>
Nov 30 10:51:05 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:51:05 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/console.log" append="off"/>
Nov 30 10:51:05 user nova-compute[75020]:     </serial>
Nov 30 10:51:05 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:51:05 user nova-compute[75020]:     <video>
Nov 30 10:51:05 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:05 user nova-compute[75020]:     </video>
Nov 30 10:51:05 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:51:05 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:51:05 user nova-compute[75020]:     </rng>
Nov 30 10:51:05 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:51:05 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:51:05 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:51:05 user nova-compute[75020]:     </memballoon>
Nov 30 10:51:05 user nova-compute[75020]:   </devices>
Nov 30 10:51:05 user nova-compute[75020]: </domain>
Nov 30 10:51:05 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1654791619',display_name='tempest-VolumesAdminNegativeTest-server-1654791619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1654791619',id=14,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348ee1a2d9e34ce8ad69a57323cbfb45',ramdisk_id='',reservation_id='r-hzuctm9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1613879927',owner_user_name='tempest-VolumesAdminNegativeTest-1613879927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:03Z,user_data=None,user_id='d0bf43699eca49558d5605f7912dc32a',uuid=a4614f08-1c9b-4c2c-b541-3cae09a4d61c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converting VIF {"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:71:db,bridge_name='br-int',has_traffic_filtering=True,id=80123461-3b78-4a9a-907b-8cf4b65af84c,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80123461-3b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_vif [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:71:db,bridge_name='br-int',has_traffic_filtering=True,id=80123461-3b78-4a9a-907b-8cf4b65af84c,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80123461-3b') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '710b4626-d38e-511a-9939-65dc5377f5ac', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80123461-3b, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80123461-3b, col_values=(('qos', UUID('122f797c-ba40-4710-8cd7-984bd56d0bbd')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80123461-3b, col_values=(('external_ids', {'iface-id': '80123461-3b78-4a9a-907b-8cf4b65af84c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:71:db', 'vm-uuid': 'a4614f08-1c9b-4c2c-b541-3cae09a4d61c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:05 user nova-compute[75020]: INFO os_vif [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:71:db,bridge_name='br-int',has_traffic_filtering=True,id=80123461-3b78-4a9a-907b-8cf4b65af84c,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80123461-3b')
Nov 30 10:51:05 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 is timed out.
Nov 30 10:51:05 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Successfully detached device vdb from instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 from the live domain config.
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoOFGuIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:51:05 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[57be6640-7fb1-42f2-8abf-87ef2753b06a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:51:05 user nova-compute[75020]: No targets found.
Nov 30 10:51:05 user nova-compute[75020]: iSNS:
Nov 30 10:51:05 user nova-compute[75020]: No targets found.
Nov 30 10:51:05 user nova-compute[75020]: STATIC:
Nov 30 10:51:05 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8
Nov 30 10:51:05 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:51:05 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:51:05 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:51:05 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:51:05 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:51:05 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:51:05 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:51:05 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:51:05 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:51:05 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:51:05 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:51:05 user nova-compute[75020]: FIRMWARE:
Nov 30 10:51:05 user nova-compute[75020]: No targets found.
Nov 30 10:51:05 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:51:05 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:51:05 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] No VIF found with MAC fa:16:3e:a2:71:db, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcd7c71-cefb-410d-b023-3fcd22508677]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fe69ef-600a-42a4-9db8-16bfbdbb068c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:51:05 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:05 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:05 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:05 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 (non-flash)
Nov 30 10:51:05 user nova-compute[75020]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:05 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:05 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:05 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad8860eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6949ed60-1ba8-40be-8cd0-01e23f3d18b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7614bb-ec80-451a-9354-0622fef50aa1]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d9af4-378a-4c25-95c6-43bb66308290]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d7f00-4cdd-49fc-86d6-cdf485d032cc]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.051s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baf48a4-7ea0-44f8-88b1-f2d6fa4ec1ed]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:06 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance spawned successfully.
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-4827ccd3-f16e-49e2-a99f-b2bfcfe2bea3 req-9bd1a95c-130b-49db-8cac-9bd93fc7b30b service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4827ccd3-f16e-49e2-a99f-b2bfcfe2bea3 req-9bd1a95c-130b-49db-8cac-9bd93fc7b30b service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4827ccd3-f16e-49e2-a99f-b2bfcfe2bea3 req-9bd1a95c-130b-49db-8cac-9bd93fc7b30b service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4827ccd3-f16e-49e2-a99f-b2bfcfe2bea3 req-9bd1a95c-130b-49db-8cac-9bd93fc7b30b service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-4827ccd3-f16e-49e2-a99f-b2bfcfe2bea3 req-9bd1a95c-130b-49db-8cac-9bd93fc7b30b service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:06 user nova-compute[75020]: WARNING nova.compute.manager [req-4827ccd3-f16e-49e2-a99f-b2bfcfe2bea3 req-9bd1a95c-130b-49db-8cac-9bd93fc7b30b service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state building and task_state spawning.
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e606d47-9bef-4e16-8deb-1a5b3e412c84]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8, portal: 172.16.0.220,3260]
Nov 30 10:51:06 user nova-compute[75020]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8, portal: 172.16.0.220,3260] successful.
Nov 30 10:51:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c4e3ea-7c45-45f9-9f7c-f378be8fa6a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4dedaf-7fd3-42a4-ac07-d40c9f4eef68]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] <== disconnect_volume: return (381ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-9883fa25-7a24-4c68-b0a4-52a713979308 req-ca8e28bd-6f9d-4521-96b4-53aeac7961ce service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Updated VIF entry in instance network info cache for port 80123461-3b78-4a9a-907b-8cf4b65af84c. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-9883fa25-7a24-4c68-b0a4-52a713979308 req-ca8e28bd-6f9d-4521-96b4-53aeac7961ce service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Updating instance_info_cache with network_info: [{"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9883fa25-7a24-4c68-b0a4-52a713979308 req-ca8e28bd-6f9d-4521-96b4-53aeac7961ce service nova] Releasing lock "refresh_cache-a4614f08-1c9b-4c2c-b541-3cae09a4d61c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:06 user nova-compute[75020]: INFO nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 30 10:51:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:51:06 user nova-compute[75020]: INFO nova.compute.manager [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Took 22.50 seconds to build instance.
Nov 30 10:51:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2fdc32e-9fe2-4e60-9677-cee106212810 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "9768f14b-9e34-421e-be7c-e541442814e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.624s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG nova.objects.instance [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lazy-loading 'flavor' on Instance uuid 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7d0ecfc9-d288-47f4-94e6-707bb4ac16b0 tempest-VolumesAssistedSnapshotsTest-878037790 tempest-VolumesAssistedSnapshotsTest-878037790-project-admin] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.959s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:51:07 user nova-compute[75020]: INFO nova.compute.claims [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Claim successful on node user
Nov 30 10:51:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.manager [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received event network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] Acquiring lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.manager [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] No waiting events found dispatching network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:08 user nova-compute[75020]: WARNING nova.compute.manager [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received unexpected event network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c for instance with vm_state building and task_state spawning.
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.manager [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received event network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] Acquiring lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.manager [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] No waiting events found dispatching network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:08 user nova-compute[75020]: WARNING nova.compute.manager [req-37ddb89e-6ccc-45d7-a150-c9d144f2d366 req-428a1896-2dff-4d80-afd8-b2f8560782c0 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received unexpected event network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c for instance with vm_state building and task_state spawning.
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:51:08 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.policy [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e5b64476e654197817bd4c65a9ff9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be013073c84dd2bb58b842e6257b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:51:08 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Creating image(s)
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "/opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "/opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Successfully created port: dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk 1073741824" returned: 0 in 0.049s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Cannot resize image /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Ensure instance console log exists: /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:51:09 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Instance spawned successfully.
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:51:09 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Waiting for libvirt event about the detach of device tap7b01937f-97 with device alias net1 from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf is timed out.
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface> {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 30 10:51:09 user nova-compute[75020]:   <name>instance-00000009</name>
Nov 30 10:51:09 user nova-compute[75020]:   <uuid>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</uuid>
Nov 30 10:51:09 user nova-compute[75020]:   <metadata>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:09 user nova-compute[75020]:   <nova:package version="0.0.0"/>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:name>tempest-device-tagging-server-737307002</nova:name>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:creationTime>2023-11-30 10:50:11</nova:creationTime>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:flavor name="m1.tiny">
Nov 30 10:51:09 user nova-compute[75020]:     <nova:memory>512</nova:memory>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:disk>1</nova:disk>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:swap>0</nova:swap>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:09 user nova-compute[75020]:   </nova:flavor>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:owner>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:user uuid="f4aa8049f42b46e5b5b8f894c56927be">tempest-TaggedAttachmentsTest-1620533068-project-member</nova:user>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:project uuid="941912a981d343bfa3e50a94195ec953">tempest-TaggedAttachmentsTest-1620533068</nova:project>
Nov 30 10:51:09 user nova-compute[75020]:   </nova:owner>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:ports>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:port uuid="e6718122-9240-4368-987f-7557ca0ed04a">
Nov 30 10:51:09 user nova-compute[75020]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 10:51:09 user nova-compute[75020]:     </nova:port>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:port uuid="7b01937f-97ba-45f8-bbb3-cd0bad2453bf">
Nov 30 10:51:09 user nova-compute[75020]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 30 10:51:09 user nova-compute[75020]:     </nova:port>
Nov 30 10:51:09 user nova-compute[75020]:   </nova:ports>
Nov 30 10:51:09 user nova-compute[75020]: </nova:instance>
Nov 30 10:51:09 user nova-compute[75020]:   </metadata>
Nov 30 10:51:09 user nova-compute[75020]:   <memory unit='KiB'>524288</memory>
Nov 30 10:51:09 user nova-compute[75020]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 10:51:09 user nova-compute[75020]:   <vcpu placement='static'>1</vcpu>
Nov 30 10:51:09 user nova-compute[75020]:   <resource>
Nov 30 10:51:09 user nova-compute[75020]:     <partition>/machine</partition>
Nov 30 10:51:09 user nova-compute[75020]:   </resource>
Nov 30 10:51:09 user nova-compute[75020]:   <sysinfo type='smbios'>
Nov 30 10:51:09 user nova-compute[75020]:     <system>
Nov 30 10:51:09 user nova-compute[75020]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 10:51:09 user nova-compute[75020]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 10:51:09 user nova-compute[75020]:       <entry name='version'>0.0.0</entry>
Nov 30 10:51:09 user nova-compute[75020]:       <entry name='serial'>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:51:09 user nova-compute[75020]:       <entry name='uuid'>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:51:09 user nova-compute[75020]:       <entry name='family'>Virtual Machine</entry>
Nov 30 10:51:09 user nova-compute[75020]:     </system>
Nov 30 10:51:09 user nova-compute[75020]:   </sysinfo>
Nov 30 10:51:09 user nova-compute[75020]:   <os>
Nov 30 10:51:09 user nova-compute[75020]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 10:51:09 user nova-compute[75020]:     <boot dev='hd'/>
Nov 30 10:51:09 user nova-compute[75020]:     <smbios mode='sysinfo'/>
Nov 30 10:51:09 user nova-compute[75020]:   </os>
Nov 30 10:51:09 user nova-compute[75020]:   <features>
Nov 30 10:51:09 user nova-compute[75020]:     <acpi/>
Nov 30 10:51:09 user nova-compute[75020]:     <apic/>
Nov 30 10:51:09 user nova-compute[75020]:     <vmcoreinfo state='on'/>
Nov 30 10:51:09 user nova-compute[75020]:   </features>
Nov 30 10:51:09 user nova-compute[75020]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 10:51:09 user nova-compute[75020]:     <model fallback='forbid'>Nehalem</model>
Nov 30 10:51:09 user nova-compute[75020]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 10:51:09 user nova-compute[75020]:     <feature policy='require' name='vme'/>
Nov 30 10:51:09 user nova-compute[75020]:     <feature policy='require' name='x2apic'/>
Nov 30 10:51:09 user nova-compute[75020]:     <feature policy='require' name='hypervisor'/>
Nov 30 10:51:09 user nova-compute[75020]:   </cpu>
Nov 30 10:51:09 user nova-compute[75020]:   <clock offset='utc'>
Nov 30 10:51:09 user nova-compute[75020]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 10:51:09 user nova-compute[75020]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 10:51:09 user nova-compute[75020]:     <timer name='hpet' present='no'/>
Nov 30 10:51:09 user nova-compute[75020]:   </clock>
Nov 30 10:51:09 user nova-compute[75020]:   <on_poweroff>destroy</on_poweroff>
Nov 30 10:51:09 user nova-compute[75020]:   <on_reboot>restart</on_reboot>
Nov 30 10:51:09 user nova-compute[75020]:   <on_crash>destroy</on_crash>
Nov 30 10:51:09 user nova-compute[75020]:   <devices>
Nov 30 10:51:09 user nova-compute[75020]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 10:51:09 user nova-compute[75020]:     <disk type='file' device='disk'>
Nov 30 10:51:09 user nova-compute[75020]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 10:51:09 user nova-compute[75020]:       <source file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk' index='2'/>
Nov 30 10:51:09 user nova-compute[75020]:       <backingStore type='file' index='3'>
Nov 30 10:51:09 user nova-compute[75020]:         <format type='raw'/>
Nov 30 10:51:09 user nova-compute[75020]:         <source file='/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814'/>
Nov 30 10:51:09 user nova-compute[75020]:         <backingStore/>
Nov 30 10:51:09 user nova-compute[75020]:       </backingStore>
Nov 30 10:51:09 user nova-compute[75020]:       <target dev='vda' bus='virtio'/>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='virtio-disk0'/>
Nov 30 10:51:09 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </disk>
Nov 30 10:51:09 user nova-compute[75020]:     <disk type='file' device='cdrom'>
Nov 30 10:51:09 user nova-compute[75020]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 10:51:09 user nova-compute[75020]:       <source file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.config' index='1'/>
Nov 30 10:51:09 user nova-compute[75020]:       <backingStore/>
Nov 30 10:51:09 user nova-compute[75020]:       <target dev='hda' bus='ide'/>
Nov 30 10:51:09 user nova-compute[75020]:       <readonly/>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='ide0-0-0'/>
Nov 30 10:51:09 user nova-compute[75020]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </disk>
Nov 30 10:51:09 user nova-compute[75020]:     <controller type='usb' index='0' model='none'>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='usb'/>
Nov 30 10:51:09 user nova-compute[75020]:     </controller>
Nov 30 10:51:09 user nova-compute[75020]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='pci.0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </controller>
Nov 30 10:51:09 user nova-compute[75020]:     <controller type='ide' index='0'>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='ide'/>
Nov 30 10:51:09 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 10:51:09 user nova-compute[75020]:     </controller>
Nov 30 10:51:09 user nova-compute[75020]:     <interface type='ethernet'>
Nov 30 10:51:09 user nova-compute[75020]:       <mac address='fa:16:3e:dc:cd:4e'/>
Nov 30 10:51:09 user nova-compute[75020]:       <target dev='tape6718122-92'/>
Nov 30 10:51:09 user nova-compute[75020]:       <model type='virtio'/>
Nov 30 10:51:09 user nova-compute[75020]:       <mtu size='1442'/>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='net0'/>
Nov 30 10:51:09 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </interface>
Nov 30 10:51:09 user nova-compute[75020]:     <serial type='pty'>
Nov 30 10:51:09 user nova-compute[75020]:       <source path='/dev/pts/8'/>
Nov 30 10:51:09 user nova-compute[75020]:       <log file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log' append='off'/>
Nov 30 10:51:09 user nova-compute[75020]:       <target type='isa-serial' port='0'>
Nov 30 10:51:09 user nova-compute[75020]:         <model name='isa-serial'/>
Nov 30 10:51:09 user nova-compute[75020]:       </target>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='serial0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </serial>
Nov 30 10:51:09 user nova-compute[75020]:     <console type='pty' tty='/dev/pts/8'>
Nov 30 10:51:09 user nova-compute[75020]:       <source path='/dev/pts/8'/>
Nov 30 10:51:09 user nova-compute[75020]:       <log file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log' append='off'/>
Nov 30 10:51:09 user nova-compute[75020]:       <target type='serial' port='0'/>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='serial0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </console>
Nov 30 10:51:09 user nova-compute[75020]:     <input type='mouse' bus='ps2'>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='input0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </input>
Nov 30 10:51:09 user nova-compute[75020]:     <input type='keyboard' bus='ps2'>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='input1'/>
Nov 30 10:51:09 user nova-compute[75020]:     </input>
Nov 30 10:51:09 user nova-compute[75020]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 30 10:51:09 user nova-compute[75020]:       <listen type='address' address='0.0.0.0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </graphics>
Nov 30 10:51:09 user nova-compute[75020]:     <audio id='1' type='none'/>
Nov 30 10:51:09 user nova-compute[75020]:     <video>
Nov 30 10:51:09 user nova-compute[75020]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='video0'/>
Nov 30 10:51:09 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </video>
Nov 30 10:51:09 user nova-compute[75020]:     <memballoon model='virtio'>
Nov 30 10:51:09 user nova-compute[75020]:       <stats period='10'/>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='balloon0'/>
Nov 30 10:51:09 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </memballoon>
Nov 30 10:51:09 user nova-compute[75020]:     <rng model='virtio'>
Nov 30 10:51:09 user nova-compute[75020]:       <backend model='random'>/dev/urandom</backend>
Nov 30 10:51:09 user nova-compute[75020]:       <alias name='rng0'/>
Nov 30 10:51:09 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 10:51:09 user nova-compute[75020]:     </rng>
Nov 30 10:51:09 user nova-compute[75020]:   </devices>
Nov 30 10:51:09 user nova-compute[75020]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 10:51:09 user nova-compute[75020]:     <label>libvirt-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</label>
Nov 30 10:51:09 user nova-compute[75020]:     <imagelabel>libvirt-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</imagelabel>
Nov 30 10:51:09 user nova-compute[75020]:   </seclabel>
Nov 30 10:51:09 user nova-compute[75020]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 10:51:09 user nova-compute[75020]:     <label>+64055:+108</label>
Nov 30 10:51:09 user nova-compute[75020]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 10:51:09 user nova-compute[75020]:   </seclabel>
Nov 30 10:51:09 user nova-compute[75020]: </domain>
Nov 30 10:51:09 user nova-compute[75020]:  {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 10:51:09 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Successfully detached device tap7b01937f-97 from instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf from the live domain config.
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converting VIF {"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG os_vif [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b01937f-97, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adeccb1b-4aa0-4d38-bfc3-6461b7837374) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:09 user nova-compute[75020]: INFO os_vif [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97')
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:09 user nova-compute[75020]:   <nova:package version="0.0.0"/>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:name>tempest-device-tagging-server-737307002</nova:name>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:creationTime>2023-11-30 10:51:09</nova:creationTime>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:flavor name="m1.tiny">
Nov 30 10:51:09 user nova-compute[75020]:     <nova:memory>512</nova:memory>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:disk>1</nova:disk>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:swap>0</nova:swap>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:09 user nova-compute[75020]:   </nova:flavor>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:owner>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:user uuid="f4aa8049f42b46e5b5b8f894c56927be">tempest-TaggedAttachmentsTest-1620533068-project-member</nova:user>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:project uuid="941912a981d343bfa3e50a94195ec953">tempest-TaggedAttachmentsTest-1620533068</nova:project>
Nov 30 10:51:09 user nova-compute[75020]:   </nova:owner>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:09 user nova-compute[75020]:   <nova:ports>
Nov 30 10:51:09 user nova-compute[75020]:     <nova:port uuid="e6718122-9240-4368-987f-7557ca0ed04a">
Nov 30 10:51:09 user nova-compute[75020]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 10:51:09 user nova-compute[75020]:     </nova:port>
Nov 30 10:51:09 user nova-compute[75020]:   </nova:ports>
Nov 30 10:51:09 user nova-compute[75020]: </nova:instance>
Nov 30 10:51:09 user nova-compute[75020]:  {{(pid=75020) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Successfully updated port: dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:51:09 user nova-compute[75020]: INFO nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquired lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-41e61b13-6b64-46d8-acdf-2c43629e8b86 req-9b4acdb6-ba34-40dd-ab2f-733531c37537 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received event network-changed-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-41e61b13-6b64-46d8-acdf-2c43629e8b86 req-9b4acdb6-ba34-40dd-ab2f-733531c37537 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Refreshing instance network info cache due to event network-changed-dbacff31-3e56-4e81-9688-f9b4514c9811. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-41e61b13-6b64-46d8-acdf-2c43629e8b86 req-9b4acdb6-ba34-40dd-ab2f-733531c37537 service nova] Acquiring lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:51:09 user nova-compute[75020]: INFO nova.compute.manager [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Took 7.07 seconds to build instance.
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-72b8dee0-2e94-46da-a7cc-798a334ec961 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.178s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Updating instance_info_cache with network_info: [{"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Releasing lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Instance network_info: |[{"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-41e61b13-6b64-46d8-acdf-2c43629e8b86 req-9b4acdb6-ba34-40dd-ab2f-733531c37537 service nova] Acquired lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.neutron [req-41e61b13-6b64-46d8-acdf-2c43629e8b86 req-9b4acdb6-ba34-40dd-ab2f-733531c37537 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Refreshing network info cache for port dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Start _get_guest_xml network_info=[{"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:51:09 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:09 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1051085553',display_name='tempest-ServersNegativeTestJSON-server-1051085553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1051085553',id=15,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07be013073c84dd2bb58b842e6257b57',ramdisk_id='',reservation_id='r-18bv8xv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-263556413',owner_user_name='tempest-ServersNegativeTestJSON-263556413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:09Z,user_data=None,user_id='0e5b64476e654197817bd4c65a9ff9c3',uuid=d7b8ec6d-d309-41dd-bfac-ba8b079fa979,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converting VIF {"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:7c,bridge_name='br-int',has_traffic_filtering=True,id=dbacff31-3e56-4e81-9688-f9b4514c9811,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbacff31-3e') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lazy-loading 'pci_devices' on Instance uuid d7b8ec6d-d309-41dd-bfac-ba8b079fa979 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:51:10 user nova-compute[75020]:   <uuid>d7b8ec6d-d309-41dd-bfac-ba8b079fa979</uuid>
Nov 30 10:51:10 user nova-compute[75020]:   <name>instance-0000000f</name>
Nov 30 10:51:10 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:51:10 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:51:10 user nova-compute[75020]:   <metadata>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:10 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:51:10 user nova-compute[75020]:       <nova:name>tempest-ServersNegativeTestJSON-server-1051085553</nova:name>
Nov 30 10:51:10 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:51:09</nova:creationTime>
Nov 30 10:51:10 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:51:10 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:51:10 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:51:10 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:51:10 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:10 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:10 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:51:10 user nova-compute[75020]:       <nova:owner>
Nov 30 10:51:10 user nova-compute[75020]:         <nova:user uuid="0e5b64476e654197817bd4c65a9ff9c3">tempest-ServersNegativeTestJSON-263556413-project-member</nova:user>
Nov 30 10:51:10 user nova-compute[75020]:         <nova:project uuid="07be013073c84dd2bb58b842e6257b57">tempest-ServersNegativeTestJSON-263556413</nova:project>
Nov 30 10:51:10 user nova-compute[75020]:       </nova:owner>
Nov 30 10:51:10 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:10 user nova-compute[75020]:       <nova:ports>
Nov 30 10:51:10 user nova-compute[75020]:         <nova:port uuid="dbacff31-3e56-4e81-9688-f9b4514c9811">
Nov 30 10:51:10 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 10:51:10 user nova-compute[75020]:         </nova:port>
Nov 30 10:51:10 user nova-compute[75020]:       </nova:ports>
Nov 30 10:51:10 user nova-compute[75020]:     </nova:instance>
Nov 30 10:51:10 user nova-compute[75020]:   </metadata>
Nov 30 10:51:10 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:51:10 user nova-compute[75020]:     <system>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name="serial">d7b8ec6d-d309-41dd-bfac-ba8b079fa979</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name="uuid">d7b8ec6d-d309-41dd-bfac-ba8b079fa979</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:51:10 user nova-compute[75020]:     </system>
Nov 30 10:51:10 user nova-compute[75020]:   </sysinfo>
Nov 30 10:51:10 user nova-compute[75020]:   <os>
Nov 30 10:51:10 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:51:10 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:51:10 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:51:10 user nova-compute[75020]:   </os>
Nov 30 10:51:10 user nova-compute[75020]:   <features>
Nov 30 10:51:10 user nova-compute[75020]:     <acpi/>
Nov 30 10:51:10 user nova-compute[75020]:     <apic/>
Nov 30 10:51:10 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:51:10 user nova-compute[75020]:   </features>
Nov 30 10:51:10 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:51:10 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:51:10 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:51:10 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:51:10 user nova-compute[75020]:   </clock>
Nov 30 10:51:10 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:51:10 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:51:10 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:51:10 user nova-compute[75020]:   </cpu>
Nov 30 10:51:10 user nova-compute[75020]:   <devices>
Nov 30 10:51:10 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:51:10 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:51:10 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk"/>
Nov 30 10:51:10 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:51:10 user nova-compute[75020]:     </disk>
Nov 30 10:51:10 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:51:10 user nova-compute[75020]:       <mac address="fa:16:3e:af:95:7c"/>
Nov 30 10:51:10 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:10 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:51:10 user nova-compute[75020]:       <target dev="tapdbacff31-3e"/>
Nov 30 10:51:10 user nova-compute[75020]:     </interface>
Nov 30 10:51:10 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:51:10 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/console.log" append="off"/>
Nov 30 10:51:10 user nova-compute[75020]:     </serial>
Nov 30 10:51:10 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:51:10 user nova-compute[75020]:     <video>
Nov 30 10:51:10 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:10 user nova-compute[75020]:     </video>
Nov 30 10:51:10 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:51:10 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:51:10 user nova-compute[75020]:     </rng>
Nov 30 10:51:10 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:51:10 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:51:10 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:51:10 user nova-compute[75020]:     </memballoon>
Nov 30 10:51:10 user nova-compute[75020]:   </devices>
Nov 30 10:51:10 user nova-compute[75020]: </domain>
Nov 30 10:51:10 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1051085553',display_name='tempest-ServersNegativeTestJSON-server-1051085553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1051085553',id=15,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07be013073c84dd2bb58b842e6257b57',ramdisk_id='',reservation_id='r-18bv8xv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-263556413',owner_user_name='tempest-ServersNegativeTestJSON-263556413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:09Z,user_data=None,user_id='0e5b64476e654197817bd4c65a9ff9c3',uuid=d7b8ec6d-d309-41dd-bfac-ba8b079fa979,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converting VIF {"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:7c,bridge_name='br-int',has_traffic_filtering=True,id=dbacff31-3e56-4e81-9688-f9b4514c9811,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbacff31-3e') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG os_vif [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:7c,bridge_name='br-int',has_traffic_filtering=True,id=dbacff31-3e56-4e81-9688-f9b4514c9811,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbacff31-3e') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0d74eaf-82ab-5f92-90a5-29c7804b192e', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbacff31-3e, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbacff31-3e, col_values=(('qos', UUID('58428650-0918-4f48-9e13-751efa7efdf3')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbacff31-3e, col_values=(('external_ids', {'iface-id': 'dbacff31-3e56-4e81-9688-f9b4514c9811', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:95:7c', 'vm-uuid': 'd7b8ec6d-d309-41dd-bfac-ba8b079fa979'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:10 user nova-compute[75020]: INFO os_vif [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:7c,bridge_name='br-int',has_traffic_filtering=True,id=dbacff31-3e56-4e81-9688-f9b4514c9811,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbacff31-3e')
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-deleted-7b01937f-97ba-45f8-bbb3-cd0bad2453bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:10 user nova-compute[75020]: INFO nova.compute.manager [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Neutron deleted interface 7b01937f-97ba-45f8-bbb3-cd0bad2453bf; detaching it from the instance and deleting it from the info cache
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.neutron [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating instance_info_cache with network_info: [{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.objects.instance [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Lazy-loading 'system_metadata' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquired lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.objects.instance [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Lazy-loading 'flavor' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] No VIF found with MAC fa:16:3e:af:95:7c, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.objects.base [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Object Instance<f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf> lazy-loaded attributes: system_metadata,flavor {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Converting VIF {"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface> {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 30 10:51:10 user nova-compute[75020]:   <name>instance-00000009</name>
Nov 30 10:51:10 user nova-compute[75020]:   <uuid>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</uuid>
Nov 30 10:51:10 user nova-compute[75020]:   <metadata>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:10 user nova-compute[75020]:   <nova:package version="0.0.0"/>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:name>tempest-device-tagging-server-737307002</nova:name>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:creationTime>2023-11-30 10:51:09</nova:creationTime>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:flavor name="m1.tiny">
Nov 30 10:51:10 user nova-compute[75020]:     <nova:memory>512</nova:memory>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:disk>1</nova:disk>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:swap>0</nova:swap>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:flavor>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:owner>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:user uuid="f4aa8049f42b46e5b5b8f894c56927be">tempest-TaggedAttachmentsTest-1620533068-project-member</nova:user>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:project uuid="941912a981d343bfa3e50a94195ec953">tempest-TaggedAttachmentsTest-1620533068</nova:project>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:owner>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:ports>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:port uuid="e6718122-9240-4368-987f-7557ca0ed04a">
Nov 30 10:51:10 user nova-compute[75020]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 10:51:10 user nova-compute[75020]:     </nova:port>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:ports>
Nov 30 10:51:10 user nova-compute[75020]: </nova:instance>
Nov 30 10:51:10 user nova-compute[75020]:   </metadata>
Nov 30 10:51:10 user nova-compute[75020]:   <memory unit='KiB'>524288</memory>
Nov 30 10:51:10 user nova-compute[75020]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 10:51:10 user nova-compute[75020]:   <vcpu placement='static'>1</vcpu>
Nov 30 10:51:10 user nova-compute[75020]:   <resource>
Nov 30 10:51:10 user nova-compute[75020]:     <partition>/machine</partition>
Nov 30 10:51:10 user nova-compute[75020]:   </resource>
Nov 30 10:51:10 user nova-compute[75020]:   <sysinfo type='smbios'>
Nov 30 10:51:10 user nova-compute[75020]:     <system>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='version'>0.0.0</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='serial'>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='uuid'>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='family'>Virtual Machine</entry>
Nov 30 10:51:10 user nova-compute[75020]:     </system>
Nov 30 10:51:10 user nova-compute[75020]:   </sysinfo>
Nov 30 10:51:10 user nova-compute[75020]:   <os>
Nov 30 10:51:10 user nova-compute[75020]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 10:51:10 user nova-compute[75020]:     <boot dev='hd'/>
Nov 30 10:51:10 user nova-compute[75020]:     <smbios mode='sysinfo'/>
Nov 30 10:51:10 user nova-compute[75020]:   </os>
Nov 30 10:51:10 user nova-compute[75020]:   <features>
Nov 30 10:51:10 user nova-compute[75020]:     <acpi/>
Nov 30 10:51:10 user nova-compute[75020]:     <apic/>
Nov 30 10:51:10 user nova-compute[75020]:     <vmcoreinfo state='on'/>
Nov 30 10:51:10 user nova-compute[75020]:   </features>
Nov 30 10:51:10 user nova-compute[75020]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 10:51:10 user nova-compute[75020]:     <model fallback='forbid'>Nehalem</model>
Nov 30 10:51:10 user nova-compute[75020]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 10:51:10 user nova-compute[75020]:     <feature policy='require' name='vme'/>
Nov 30 10:51:10 user nova-compute[75020]:     <feature policy='require' name='x2apic'/>
Nov 30 10:51:10 user nova-compute[75020]:     <feature policy='require' name='hypervisor'/>
Nov 30 10:51:10 user nova-compute[75020]:   </cpu>
Nov 30 10:51:10 user nova-compute[75020]:   <clock offset='utc'>
Nov 30 10:51:10 user nova-compute[75020]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 10:51:10 user nova-compute[75020]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 10:51:10 user nova-compute[75020]:     <timer name='hpet' present='no'/>
Nov 30 10:51:10 user nova-compute[75020]:   </clock>
Nov 30 10:51:10 user nova-compute[75020]:   <on_poweroff>destroy</on_poweroff>
Nov 30 10:51:10 user nova-compute[75020]:   <on_reboot>restart</on_reboot>
Nov 30 10:51:10 user nova-compute[75020]:   <on_crash>destroy</on_crash>
Nov 30 10:51:10 user nova-compute[75020]:   <devices>
Nov 30 10:51:10 user nova-compute[75020]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 10:51:10 user nova-compute[75020]:     <disk type='file' device='disk'>
Nov 30 10:51:10 user nova-compute[75020]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 10:51:10 user nova-compute[75020]:       <source file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk' index='2'/>
Nov 30 10:51:10 user nova-compute[75020]:       <backingStore type='file' index='3'>
Nov 30 10:51:10 user nova-compute[75020]:         <format type='raw'/>
Nov 30 10:51:10 user nova-compute[75020]:         <source file='/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814'/>
Nov 30 10:51:10 user nova-compute[75020]:         <backingStore/>
Nov 30 10:51:10 user nova-compute[75020]:       </backingStore>
Nov 30 10:51:10 user nova-compute[75020]:       <target dev='vda' bus='virtio'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='virtio-disk0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </disk>
Nov 30 10:51:10 user nova-compute[75020]:     <disk type='file' device='cdrom'>
Nov 30 10:51:10 user nova-compute[75020]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 10:51:10 user nova-compute[75020]:       <source file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.config' index='1'/>
Nov 30 10:51:10 user nova-compute[75020]:       <backingStore/>
Nov 30 10:51:10 user nova-compute[75020]:       <target dev='hda' bus='ide'/>
Nov 30 10:51:10 user nova-compute[75020]:       <readonly/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='ide0-0-0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </disk>
Nov 30 10:51:10 user nova-compute[75020]:     <controller type='usb' index='0' model='none'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='usb'/>
Nov 30 10:51:10 user nova-compute[75020]:     </controller>
Nov 30 10:51:10 user nova-compute[75020]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='pci.0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </controller>
Nov 30 10:51:10 user nova-compute[75020]:     <controller type='ide' index='0'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='ide'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 10:51:10 user nova-compute[75020]:     </controller>
Nov 30 10:51:10 user nova-compute[75020]:     <interface type='ethernet'>
Nov 30 10:51:10 user nova-compute[75020]:       <mac address='fa:16:3e:dc:cd:4e'/>
Nov 30 10:51:10 user nova-compute[75020]:       <target dev='tape6718122-92'/>
Nov 30 10:51:10 user nova-compute[75020]:       <model type='virtio'/>
Nov 30 10:51:10 user nova-compute[75020]:       <mtu size='1442'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='net0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </interface>
Nov 30 10:51:10 user nova-compute[75020]:     <serial type='pty'>
Nov 30 10:51:10 user nova-compute[75020]:       <source path='/dev/pts/8'/>
Nov 30 10:51:10 user nova-compute[75020]:       <log file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log' append='off'/>
Nov 30 10:51:10 user nova-compute[75020]:       <target type='isa-serial' port='0'>
Nov 30 10:51:10 user nova-compute[75020]:         <model name='isa-serial'/>
Nov 30 10:51:10 user nova-compute[75020]:       </target>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='serial0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </serial>
Nov 30 10:51:10 user nova-compute[75020]:     <console type='pty' tty='/dev/pts/8'>
Nov 30 10:51:10 user nova-compute[75020]:       <source path='/dev/pts/8'/>
Nov 30 10:51:10 user nova-compute[75020]:       <log file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log' append='off'/>
Nov 30 10:51:10 user nova-compute[75020]:       <target type='serial' port='0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='serial0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </console>
Nov 30 10:51:10 user nova-compute[75020]:     <input type='mouse' bus='ps2'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='input0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </input>
Nov 30 10:51:10 user nova-compute[75020]:     <input type='keyboard' bus='ps2'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='input1'/>
Nov 30 10:51:10 user nova-compute[75020]:     </input>
Nov 30 10:51:10 user nova-compute[75020]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 30 10:51:10 user nova-compute[75020]:       <listen type='address' address='0.0.0.0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </graphics>
Nov 30 10:51:10 user nova-compute[75020]:     <audio id='1' type='none'/>
Nov 30 10:51:10 user nova-compute[75020]:     <video>
Nov 30 10:51:10 user nova-compute[75020]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='video0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </video>
Nov 30 10:51:10 user nova-compute[75020]:     <memballoon model='virtio'>
Nov 30 10:51:10 user nova-compute[75020]:       <stats period='10'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='balloon0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </memballoon>
Nov 30 10:51:10 user nova-compute[75020]:     <rng model='virtio'>
Nov 30 10:51:10 user nova-compute[75020]:       <backend model='random'>/dev/urandom</backend>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='rng0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </rng>
Nov 30 10:51:10 user nova-compute[75020]:   </devices>
Nov 30 10:51:10 user nova-compute[75020]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 10:51:10 user nova-compute[75020]:     <label>libvirt-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</label>
Nov 30 10:51:10 user nova-compute[75020]:     <imagelabel>libvirt-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</imagelabel>
Nov 30 10:51:10 user nova-compute[75020]:   </seclabel>
Nov 30 10:51:10 user nova-compute[75020]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 10:51:10 user nova-compute[75020]:     <label>+64055:+108</label>
Nov 30 10:51:10 user nova-compute[75020]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 10:51:10 user nova-compute[75020]:   </seclabel>
Nov 30 10:51:10 user nova-compute[75020]: </domain>
Nov 30 10:51:10 user nova-compute[75020]:  {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface> {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.neutron [req-41e61b13-6b64-46d8-acdf-2c43629e8b86 req-9b4acdb6-ba34-40dd-ab2f-733531c37537 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Updated VIF entry in instance network info cache for port dbacff31-3e56-4e81-9688-f9b4514c9811. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.neutron [req-41e61b13-6b64-46d8-acdf-2c43629e8b86 req-9b4acdb6-ba34-40dd-ab2f-733531c37537 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Updating instance_info_cache with network_info: [{"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0b:ad:9c"/><model type="virtio"/><mtu size="1442"/><target dev="tap7b01937f-97"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 30 10:51:10 user nova-compute[75020]:   <name>instance-00000009</name>
Nov 30 10:51:10 user nova-compute[75020]:   <uuid>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</uuid>
Nov 30 10:51:10 user nova-compute[75020]:   <metadata>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:10 user nova-compute[75020]:   <nova:package version="0.0.0"/>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:name>tempest-device-tagging-server-737307002</nova:name>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:creationTime>2023-11-30 10:51:09</nova:creationTime>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:flavor name="m1.tiny">
Nov 30 10:51:10 user nova-compute[75020]:     <nova:memory>512</nova:memory>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:disk>1</nova:disk>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:swap>0</nova:swap>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:flavor>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:owner>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:user uuid="f4aa8049f42b46e5b5b8f894c56927be">tempest-TaggedAttachmentsTest-1620533068-project-member</nova:user>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:project uuid="941912a981d343bfa3e50a94195ec953">tempest-TaggedAttachmentsTest-1620533068</nova:project>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:owner>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:ports>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:port uuid="e6718122-9240-4368-987f-7557ca0ed04a">
Nov 30 10:51:10 user nova-compute[75020]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 10:51:10 user nova-compute[75020]:     </nova:port>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:ports>
Nov 30 10:51:10 user nova-compute[75020]: </nova:instance>
Nov 30 10:51:10 user nova-compute[75020]:   </metadata>
Nov 30 10:51:10 user nova-compute[75020]:   <memory unit='KiB'>524288</memory>
Nov 30 10:51:10 user nova-compute[75020]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 10:51:10 user nova-compute[75020]:   <vcpu placement='static'>1</vcpu>
Nov 30 10:51:10 user nova-compute[75020]:   <resource>
Nov 30 10:51:10 user nova-compute[75020]:     <partition>/machine</partition>
Nov 30 10:51:10 user nova-compute[75020]:   </resource>
Nov 30 10:51:10 user nova-compute[75020]:   <sysinfo type='smbios'>
Nov 30 10:51:10 user nova-compute[75020]:     <system>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='version'>0.0.0</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='serial'>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='uuid'>f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</entry>
Nov 30 10:51:10 user nova-compute[75020]:       <entry name='family'>Virtual Machine</entry>
Nov 30 10:51:10 user nova-compute[75020]:     </system>
Nov 30 10:51:10 user nova-compute[75020]:   </sysinfo>
Nov 30 10:51:10 user nova-compute[75020]:   <os>
Nov 30 10:51:10 user nova-compute[75020]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 10:51:10 user nova-compute[75020]:     <boot dev='hd'/>
Nov 30 10:51:10 user nova-compute[75020]:     <smbios mode='sysinfo'/>
Nov 30 10:51:10 user nova-compute[75020]:   </os>
Nov 30 10:51:10 user nova-compute[75020]:   <features>
Nov 30 10:51:10 user nova-compute[75020]:     <acpi/>
Nov 30 10:51:10 user nova-compute[75020]:     <apic/>
Nov 30 10:51:10 user nova-compute[75020]:     <vmcoreinfo state='on'/>
Nov 30 10:51:10 user nova-compute[75020]:   </features>
Nov 30 10:51:10 user nova-compute[75020]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 10:51:10 user nova-compute[75020]:     <model fallback='forbid'>Nehalem</model>
Nov 30 10:51:10 user nova-compute[75020]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 10:51:10 user nova-compute[75020]:     <feature policy='require' name='vme'/>
Nov 30 10:51:10 user nova-compute[75020]:     <feature policy='require' name='x2apic'/>
Nov 30 10:51:10 user nova-compute[75020]:     <feature policy='require' name='hypervisor'/>
Nov 30 10:51:10 user nova-compute[75020]:   </cpu>
Nov 30 10:51:10 user nova-compute[75020]:   <clock offset='utc'>
Nov 30 10:51:10 user nova-compute[75020]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 10:51:10 user nova-compute[75020]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 10:51:10 user nova-compute[75020]:     <timer name='hpet' present='no'/>
Nov 30 10:51:10 user nova-compute[75020]:   </clock>
Nov 30 10:51:10 user nova-compute[75020]:   <on_poweroff>destroy</on_poweroff>
Nov 30 10:51:10 user nova-compute[75020]:   <on_reboot>restart</on_reboot>
Nov 30 10:51:10 user nova-compute[75020]:   <on_crash>destroy</on_crash>
Nov 30 10:51:10 user nova-compute[75020]:   <devices>
Nov 30 10:51:10 user nova-compute[75020]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 10:51:10 user nova-compute[75020]:     <disk type='file' device='disk'>
Nov 30 10:51:10 user nova-compute[75020]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 10:51:10 user nova-compute[75020]:       <source file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk' index='2'/>
Nov 30 10:51:10 user nova-compute[75020]:       <backingStore type='file' index='3'>
Nov 30 10:51:10 user nova-compute[75020]:         <format type='raw'/>
Nov 30 10:51:10 user nova-compute[75020]:         <source file='/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814'/>
Nov 30 10:51:10 user nova-compute[75020]:         <backingStore/>
Nov 30 10:51:10 user nova-compute[75020]:       </backingStore>
Nov 30 10:51:10 user nova-compute[75020]:       <target dev='vda' bus='virtio'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='virtio-disk0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </disk>
Nov 30 10:51:10 user nova-compute[75020]:     <disk type='file' device='cdrom'>
Nov 30 10:51:10 user nova-compute[75020]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 10:51:10 user nova-compute[75020]:       <source file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk.config' index='1'/>
Nov 30 10:51:10 user nova-compute[75020]:       <backingStore/>
Nov 30 10:51:10 user nova-compute[75020]:       <target dev='hda' bus='ide'/>
Nov 30 10:51:10 user nova-compute[75020]:       <readonly/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='ide0-0-0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </disk>
Nov 30 10:51:10 user nova-compute[75020]:     <controller type='usb' index='0' model='none'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='usb'/>
Nov 30 10:51:10 user nova-compute[75020]:     </controller>
Nov 30 10:51:10 user nova-compute[75020]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='pci.0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </controller>
Nov 30 10:51:10 user nova-compute[75020]:     <controller type='ide' index='0'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='ide'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 10:51:10 user nova-compute[75020]:     </controller>
Nov 30 10:51:10 user nova-compute[75020]:     <interface type='ethernet'>
Nov 30 10:51:10 user nova-compute[75020]:       <mac address='fa:16:3e:dc:cd:4e'/>
Nov 30 10:51:10 user nova-compute[75020]:       <target dev='tape6718122-92'/>
Nov 30 10:51:10 user nova-compute[75020]:       <model type='virtio'/>
Nov 30 10:51:10 user nova-compute[75020]:       <mtu size='1442'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='net0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </interface>
Nov 30 10:51:10 user nova-compute[75020]:     <serial type='pty'>
Nov 30 10:51:10 user nova-compute[75020]:       <source path='/dev/pts/8'/>
Nov 30 10:51:10 user nova-compute[75020]:       <log file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log' append='off'/>
Nov 30 10:51:10 user nova-compute[75020]:       <target type='isa-serial' port='0'>
Nov 30 10:51:10 user nova-compute[75020]:         <model name='isa-serial'/>
Nov 30 10:51:10 user nova-compute[75020]:       </target>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='serial0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </serial>
Nov 30 10:51:10 user nova-compute[75020]:     <console type='pty' tty='/dev/pts/8'>
Nov 30 10:51:10 user nova-compute[75020]:       <source path='/dev/pts/8'/>
Nov 30 10:51:10 user nova-compute[75020]:       <log file='/opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/console.log' append='off'/>
Nov 30 10:51:10 user nova-compute[75020]:       <target type='serial' port='0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='serial0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </console>
Nov 30 10:51:10 user nova-compute[75020]:     <input type='mouse' bus='ps2'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='input0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </input>
Nov 30 10:51:10 user nova-compute[75020]:     <input type='keyboard' bus='ps2'>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='input1'/>
Nov 30 10:51:10 user nova-compute[75020]:     </input>
Nov 30 10:51:10 user nova-compute[75020]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 30 10:51:10 user nova-compute[75020]:       <listen type='address' address='0.0.0.0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </graphics>
Nov 30 10:51:10 user nova-compute[75020]:     <audio id='1' type='none'/>
Nov 30 10:51:10 user nova-compute[75020]:     <video>
Nov 30 10:51:10 user nova-compute[75020]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='video0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </video>
Nov 30 10:51:10 user nova-compute[75020]:     <memballoon model='virtio'>
Nov 30 10:51:10 user nova-compute[75020]:       <stats period='10'/>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='balloon0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </memballoon>
Nov 30 10:51:10 user nova-compute[75020]:     <rng model='virtio'>
Nov 30 10:51:10 user nova-compute[75020]:       <backend model='random'>/dev/urandom</backend>
Nov 30 10:51:10 user nova-compute[75020]:       <alias name='rng0'/>
Nov 30 10:51:10 user nova-compute[75020]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 10:51:10 user nova-compute[75020]:     </rng>
Nov 30 10:51:10 user nova-compute[75020]:   </devices>
Nov 30 10:51:10 user nova-compute[75020]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 10:51:10 user nova-compute[75020]:     <label>libvirt-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</label>
Nov 30 10:51:10 user nova-compute[75020]:     <imagelabel>libvirt-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf</imagelabel>
Nov 30 10:51:10 user nova-compute[75020]:   </seclabel>
Nov 30 10:51:10 user nova-compute[75020]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 10:51:10 user nova-compute[75020]:     <label>+64055:+108</label>
Nov 30 10:51:10 user nova-compute[75020]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 10:51:10 user nova-compute[75020]:   </seclabel>
Nov 30 10:51:10 user nova-compute[75020]: </domain>
Nov 30 10:51:10 user nova-compute[75020]:  {{(pid=75020) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 10:51:10 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Detaching interface fa:16:3e:0b:ad:9c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap7b01937f-97' not found.
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Converting VIF {"id": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "address": "fa:16:3e:0b:ad:9c", "network": {"id": "79f7ec8c-cd34-4bdb-b12d-619540866ff9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-76730060", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b01937f-97", "ovs_interfaceid": "7b01937f-97ba-45f8-bbb3-cd0bad2453bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG os_vif [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b01937f-97, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:51:10 user nova-compute[75020]: INFO os_vif [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ad:9c,bridge_name='br-int',has_traffic_filtering=True,id=7b01937f-97ba-45f8-bbb3-cd0bad2453bf,network=Network(79f7ec8c-cd34-4bdb-b12d-619540866ff9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b01937f-97')
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [req-bb70a9f7-27da-4080-b6cc-da4275116b77 req-201d1d64-e822-4602-abaf-48da92417f34 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:10 user nova-compute[75020]:   <nova:package version="0.0.0"/>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:name>tempest-device-tagging-server-737307002</nova:name>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:creationTime>2023-11-30 10:51:10</nova:creationTime>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:flavor name="m1.tiny">
Nov 30 10:51:10 user nova-compute[75020]:     <nova:memory>512</nova:memory>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:disk>1</nova:disk>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:swap>0</nova:swap>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:flavor>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:owner>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:user uuid="f4aa8049f42b46e5b5b8f894c56927be">tempest-TaggedAttachmentsTest-1620533068-project-member</nova:user>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:project uuid="941912a981d343bfa3e50a94195ec953">tempest-TaggedAttachmentsTest-1620533068</nova:project>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:owner>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:10 user nova-compute[75020]:   <nova:ports>
Nov 30 10:51:10 user nova-compute[75020]:     <nova:port uuid="e6718122-9240-4368-987f-7557ca0ed04a">
Nov 30 10:51:10 user nova-compute[75020]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 10:51:10 user nova-compute[75020]:     </nova:port>
Nov 30 10:51:10 user nova-compute[75020]:   </nova:ports>
Nov 30 10:51:10 user nova-compute[75020]: </nova:instance>
Nov 30 10:51:10 user nova-compute[75020]:  {{(pid=75020) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-41e61b13-6b64-46d8-acdf-2c43629e8b86 req-9b4acdb6-ba34-40dd-ab2f-733531c37537 service nova] Releasing lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating instance_info_cache with network_info: [{"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Releasing lock "refresh_cache-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d8c347b7-9a41-4649-bd74-c6a7895acb91 tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "interface-f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-7b01937f-97ba-45f8-bbb3-cd0bad2453bf" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.689s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-b4e9404d-e21d-473e-be3e-cd8749202d55 req-a0ccac6c-4377-4a7c-8817-e2817e8ff899 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received event network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b4e9404d-e21d-473e-be3e-cd8749202d55 req-a0ccac6c-4377-4a7c-8817-e2817e8ff899 service nova] Acquiring lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b4e9404d-e21d-473e-be3e-cd8749202d55 req-a0ccac6c-4377-4a7c-8817-e2817e8ff899 service nova] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b4e9404d-e21d-473e-be3e-cd8749202d55 req-a0ccac6c-4377-4a7c-8817-e2817e8ff899 service nova] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-b4e9404d-e21d-473e-be3e-cd8749202d55 req-a0ccac6c-4377-4a7c-8817-e2817e8ff899 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] No waiting events found dispatching network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:12 user nova-compute[75020]: WARNING nova.compute.manager [req-b4e9404d-e21d-473e-be3e-cd8749202d55 req-a0ccac6c-4377-4a7c-8817-e2817e8ff899 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received unexpected event network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 for instance with vm_state building and task_state spawning.
Nov 30 10:51:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:51:13 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Instance spawned successfully.
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:13 user nova-compute[75020]: INFO nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 30 10:51:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:51:14 user nova-compute[75020]: INFO nova.compute.manager [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Took 6.09 seconds to build instance.
Nov 30 10:51:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e0023a99-4d22-4b43-8fd6-fd784b2f33e5 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.202s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-69160cb5-f0cb-4ca7-96be-115c24aae2bc req-8268fb2f-356e-452d-9f3b-d0e56cba13fc service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received event network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69160cb5-f0cb-4ca7-96be-115c24aae2bc req-8268fb2f-356e-452d-9f3b-d0e56cba13fc service nova] Acquiring lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69160cb5-f0cb-4ca7-96be-115c24aae2bc req-8268fb2f-356e-452d-9f3b-d0e56cba13fc service nova] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69160cb5-f0cb-4ca7-96be-115c24aae2bc req-8268fb2f-356e-452d-9f3b-d0e56cba13fc service nova] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-69160cb5-f0cb-4ca7-96be-115c24aae2bc req-8268fb2f-356e-452d-9f3b-d0e56cba13fc service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] No waiting events found dispatching network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:14 user nova-compute[75020]: WARNING nova.compute.manager [req-69160cb5-f0cb-4ca7-96be-115c24aae2bc req-8268fb2f-356e-452d-9f3b-d0e56cba13fc service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received unexpected event network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 for instance with vm_state active and task_state None.
Nov 30 10:51:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-7bfbbe1f-83d9-4d8c-a057-474ea949e0cc req-cd4592f6-133c-4256-ab9c-04fc95df57eb service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received event network-changed-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-7bfbbe1f-83d9-4d8c-a057-474ea949e0cc req-cd4592f6-133c-4256-ab9c-04fc95df57eb service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Refreshing instance network info cache due to event network-changed-1d101f28-52a3-478f-adc4-58faea79f485. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:51:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7bfbbe1f-83d9-4d8c-a057-474ea949e0cc req-cd4592f6-133c-4256-ab9c-04fc95df57eb service nova] Acquiring lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7bfbbe1f-83d9-4d8c-a057-474ea949e0cc req-cd4592f6-133c-4256-ab9c-04fc95df57eb service nova] Acquired lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-7bfbbe1f-83d9-4d8c-a057-474ea949e0cc req-cd4592f6-133c-4256-ab9c-04fc95df57eb service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Refreshing network info cache for port 1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:51:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-7bfbbe1f-83d9-4d8c-a057-474ea949e0cc req-cd4592f6-133c-4256-ab9c-04fc95df57eb service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updated VIF entry in instance network info cache for port 1d101f28-52a3-478f-adc4-58faea79f485. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:51:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-7bfbbe1f-83d9-4d8c-a057-474ea949e0cc req-cd4592f6-133c-4256-ab9c-04fc95df57eb service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating instance_info_cache with network_info: [{"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7bfbbe1f-83d9-4d8c-a057-474ea949e0cc req-cd4592f6-133c-4256-ab9c-04fc95df57eb service nova] Releasing lock "refresh_cache-afb7644a-9d91-4a5e-a75c-6d55a0d158d2" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:23 user nova-compute[75020]: INFO nova.compute.manager [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attaching volume 4fb6d790-61c7-4b90-afd5-bc1d316ece3a to /dev/vdb
Nov 30 10:51:23 user nova-compute[75020]: DEBUG os_brick.utils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e70cd19-42b5-47a5-9576-d46abb4f1945]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebd68be-4b94-4785-bc79-d0ea92d4a315]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c644ba-f377-44eb-9869-f3e281ea202b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[724ead3e-2785-4aa4-80d2-5c579bac3946]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:51:23 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:51:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01a9a1-2728-4ab1-b15e-9300ed576672]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG os_brick.utils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:51:23 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating existing volume attachment record: 06ab1ba6-ce87-4daa-ab46-56b4206a5f02 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:51:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRePSNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:51:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:51:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:51:32 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ebc324-114e-4ba0-a9e0-1af3fb8e1131]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:51:32 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[01303d19-665e-48d0-b15e-83f0e26dbf59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a] added
Nov 30 10:51:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5680d8-142e-43c3-8b9b-d858276ef24e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6970b6-0b80-4e08-90c6-03a253e1df65]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkRePSNp {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkRePSNp" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8caf5df-45ca-4a77-9013-c74864b621af]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkRePSNp'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[15519b74-a0e4-4e41-8ac1-44e215da3343]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[51375499-7afe-4132-a8f0-bda9195e26a6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cc5426-55da-4148-93ff-dfd0918c43ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a, portal: 172.16.0.220,3260]
Nov 30 10:51:33 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a, portal: 172.16.0.220,3260] successful.
Nov 30 10:51:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a017b8d-7c7f-4dee-bc1c-e7c719e29c2c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df56ce-3456-4921-af42-043529835556]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:51:33 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfcf406-ae14-4be5-89f5-67a6093b3b38]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRePSNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23464333037336464', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464333037336464', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:51:34 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:51:34 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:51:34 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:51:34 user nova-compute[75020]:   <serial>4fb6d790-61c7-4b90-afd5-bc1d316ece3a</serial>
Nov 30 10:51:34 user nova-compute[75020]: </disk>
Nov 30 10:51:34 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No VIF found with MAC fa:16:3e:09:53:aa, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:51:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b47e6102-ad26-4e64-81ed-f0626de6960a tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.316s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:51:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:51:36 user nova-compute[75020]: INFO nova.compute.claims [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Claim successful on node user
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.network.neutron [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:51:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.policy [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f64ef255b2a48349a280bf3693af23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10919b523b740859f3ac98e31468a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:51:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Creating image(s)
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.213s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk 1073741824" returned: 0 in 0.066s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Cannot resize image /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Ensure instance console log exists: /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG nova.network.neutron [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Successfully created port: 78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Successfully updated port: 78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquired lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-5b2e546e-d323-4360-80b3-40f55c2d4559 req-2242e4cf-0611-4604-8c19-5e3cae4839bd service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-changed-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-5b2e546e-d323-4360-80b3-40f55c2d4559 req-2242e4cf-0611-4604-8c19-5e3cae4839bd service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Refreshing instance network info cache due to event network-changed-78557a1a-289d-4be3-b859-f3f8623fd45c. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5b2e546e-d323-4360-80b3-40f55c2d4559 req-2242e4cf-0611-4604-8c19-5e3cae4839bd service nova] Acquiring lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Updating instance_info_cache with network_info: [{"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Releasing lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance network_info: |[{"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5b2e546e-d323-4360-80b3-40f55c2d4559 req-2242e4cf-0611-4604-8c19-5e3cae4839bd service nova] Acquired lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-5b2e546e-d323-4360-80b3-40f55c2d4559 req-2242e4cf-0611-4604-8c19-5e3cae4839bd service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Refreshing network info cache for port 78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Start _get_guest_xml network_info=[{"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:40 user nova-compute[75020]: INFO nova.compute.manager [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Terminating instance
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1577208617',display_name='tempest-tempest.common.compute-instance-1577208617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1577208617',id=16,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3MNl3vXIHlAfMzsSD6x85put1v2rIbFO9K/J0NJAsxh65y9x1lCMG9kdMXXWUSt8sUghYnnEKtixmuW/zp2tDBop3t0gGhOp7QoNP2SrpDfBfgLTTvhtOaN0iqFAnesA==',key_name='tempest-keypair-800322414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-7ognsntj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=5e5dcbe8-47e9-4cf8-861b-84f37c1c6608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.objects.instance [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: INFO nova.compute.manager [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Terminating instance
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:51:40 user nova-compute[75020]:   <uuid>5e5dcbe8-47e9-4cf8-861b-84f37c1c6608</uuid>
Nov 30 10:51:40 user nova-compute[75020]:   <name>instance-00000010</name>
Nov 30 10:51:40 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:51:40 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:51:40 user nova-compute[75020]:   <metadata>
Nov 30 10:51:40 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:40 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:51:40 user nova-compute[75020]:       <nova:name>tempest-tempest.common.compute-instance-1577208617</nova:name>
Nov 30 10:51:40 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:51:40</nova:creationTime>
Nov 30 10:51:40 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:51:40 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:51:40 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:51:40 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:51:40 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:40 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:40 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:51:40 user nova-compute[75020]:       <nova:owner>
Nov 30 10:51:40 user nova-compute[75020]:         <nova:user uuid="7f64ef255b2a48349a280bf3693af23f">tempest-ServerActionsTestOtherA-582760806-project-member</nova:user>
Nov 30 10:51:40 user nova-compute[75020]:         <nova:project uuid="e10919b523b740859f3ac98e31468a93">tempest-ServerActionsTestOtherA-582760806</nova:project>
Nov 30 10:51:40 user nova-compute[75020]:       </nova:owner>
Nov 30 10:51:40 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:40 user nova-compute[75020]:       <nova:ports>
Nov 30 10:51:40 user nova-compute[75020]:         <nova:port uuid="78557a1a-289d-4be3-b859-f3f8623fd45c">
Nov 30 10:51:40 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 10:51:40 user nova-compute[75020]:         </nova:port>
Nov 30 10:51:40 user nova-compute[75020]:       </nova:ports>
Nov 30 10:51:40 user nova-compute[75020]:     </nova:instance>
Nov 30 10:51:40 user nova-compute[75020]:   </metadata>
Nov 30 10:51:40 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:51:40 user nova-compute[75020]:     <system>
Nov 30 10:51:40 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:51:40 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:51:40 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:51:40 user nova-compute[75020]:       <entry name="serial">5e5dcbe8-47e9-4cf8-861b-84f37c1c6608</entry>
Nov 30 10:51:40 user nova-compute[75020]:       <entry name="uuid">5e5dcbe8-47e9-4cf8-861b-84f37c1c6608</entry>
Nov 30 10:51:40 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:51:40 user nova-compute[75020]:     </system>
Nov 30 10:51:40 user nova-compute[75020]:   </sysinfo>
Nov 30 10:51:40 user nova-compute[75020]:   <os>
Nov 30 10:51:40 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:51:40 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:51:40 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:51:40 user nova-compute[75020]:   </os>
Nov 30 10:51:40 user nova-compute[75020]:   <features>
Nov 30 10:51:40 user nova-compute[75020]:     <acpi/>
Nov 30 10:51:40 user nova-compute[75020]:     <apic/>
Nov 30 10:51:40 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:51:40 user nova-compute[75020]:   </features>
Nov 30 10:51:40 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:51:40 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:51:40 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:51:40 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:51:40 user nova-compute[75020]:   </clock>
Nov 30 10:51:40 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:51:40 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:51:40 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:51:40 user nova-compute[75020]:   </cpu>
Nov 30 10:51:40 user nova-compute[75020]:   <devices>
Nov 30 10:51:40 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:51:40 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:51:40 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk"/>
Nov 30 10:51:40 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:51:40 user nova-compute[75020]:     </disk>
Nov 30 10:51:40 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:51:40 user nova-compute[75020]:       <mac address="fa:16:3e:19:a2:5f"/>
Nov 30 10:51:40 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:40 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:51:40 user nova-compute[75020]:       <target dev="tap78557a1a-28"/>
Nov 30 10:51:40 user nova-compute[75020]:     </interface>
Nov 30 10:51:40 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:51:40 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/console.log" append="off"/>
Nov 30 10:51:40 user nova-compute[75020]:     </serial>
Nov 30 10:51:40 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:51:40 user nova-compute[75020]:     <video>
Nov 30 10:51:40 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:40 user nova-compute[75020]:     </video>
Nov 30 10:51:40 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:51:40 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:51:40 user nova-compute[75020]:     </rng>
Nov 30 10:51:40 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:51:40 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:51:40 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:51:40 user nova-compute[75020]:     </memballoon>
Nov 30 10:51:40 user nova-compute[75020]:   </devices>
Nov 30 10:51:40 user nova-compute[75020]: </domain>
Nov 30 10:51:40 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1577208617',display_name='tempest-tempest.common.compute-instance-1577208617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1577208617',id=16,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3MNl3vXIHlAfMzsSD6x85put1v2rIbFO9K/J0NJAsxh65y9x1lCMG9kdMXXWUSt8sUghYnnEKtixmuW/zp2tDBop3t0gGhOp7QoNP2SrpDfBfgLTTvhtOaN0iqFAnesA==',key_name='tempest-keypair-800322414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-7ognsntj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=5e5dcbe8-47e9-4cf8-861b-84f37c1c6608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG os_vif [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '021a12ba-5a70-5e10-b3d0-154e16661f27', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:40 user nova-compute[75020]: INFO nova.compute.manager [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Unshelving
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78557a1a-28, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78557a1a-28, col_values=(('qos', UUID('f0b03283-499f-477f-b848-0082a9c4f5c5')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78557a1a-28, col_values=(('external_ids', {'iface-id': '78557a1a-289d-4be3-b859-f3f8623fd45c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:a2:5f', 'vm-uuid': '5e5dcbe8-47e9-4cf8-861b-84f37c1c6608'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: INFO os_vif [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28')
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: INFO nova.virt.block_device [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Booting with volume 6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb at /dev/vdc
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No VIF found with MAC fa:16:3e:19:a2:5f, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG os_brick.utils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e98dd37-c8fc-4311-ba63-78db106b0b3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a354a4-d2cb-4aa9-9413-aef61f9f3ed0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[209e1a0f-4040-4eb9-b9e1-a41c186a79c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e988450-be8e-4e47-b366-c734369850ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:51:40 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e451dc-3e6d-498a-8781-b63fe74c7725]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG os_brick.utils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating existing volume attachment record: 0d8bb032-e7a6-4150-a021-d3b13c07db62 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-ce38fbd1-8143-4eba-a8fd-0007ce2383d0 req-4cec611d-2480-4373-8e5f-eda3f795553f service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-unplugged-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ce38fbd1-8143-4eba-a8fd-0007ce2383d0 req-4cec611d-2480-4373-8e5f-eda3f795553f service nova] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ce38fbd1-8143-4eba-a8fd-0007ce2383d0 req-4cec611d-2480-4373-8e5f-eda3f795553f service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ce38fbd1-8143-4eba-a8fd-0007ce2383d0 req-4cec611d-2480-4373-8e5f-eda3f795553f service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-ce38fbd1-8143-4eba-a8fd-0007ce2383d0 req-4cec611d-2480-4373-8e5f-eda3f795553f service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] No waiting events found dispatching network-vif-unplugged-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-ce38fbd1-8143-4eba-a8fd-0007ce2383d0 req-4cec611d-2480-4373-8e5f-eda3f795553f service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-unplugged-e6718122-9240-4368-987f-7557ca0ed04a for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.network.neutron [req-5b2e546e-d323-4360-80b3-40f55c2d4559 req-2242e4cf-0611-4604-8c19-5e3cae4839bd service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Updated VIF entry in instance network info cache for port 78557a1a-289d-4be3-b859-f3f8623fd45c. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.network.neutron [req-5b2e546e-d323-4360-80b3-40f55c2d4559 req-2242e4cf-0611-4604-8c19-5e3cae4839bd service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Updating instance_info_cache with network_info: [{"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5b2e546e-d323-4360-80b3-40f55c2d4559 req-2242e4cf-0611-4604-8c19-5e3cae4839bd service nova] Releasing lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received event network-vif-unplugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] No waiting events found dispatching network-vif-unplugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received event network-vif-unplugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received event network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] Acquiring lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] No waiting events found dispatching network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:41 user nova-compute[75020]: WARNING nova.compute.manager [req-95813769-841d-45bd-a62f-8afae153694b req-b3b66978-9623-4ebc-9402-85c10c62a631 service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received unexpected event network-vif-plugged-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 for instance with vm_state active and task_state deleting.
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Instance destroyed successfully.
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lazy-loading 'resources' on Instance uuid 546b1a78-e8e9-40ac-ad39-c4eaa1539f91 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-419067090',display_name='tempest-VolumesAssistedSnapshotsTest-server-419067090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-419067090',id=10,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOPJzvxOqxd0Hahpg/ZLlZ30MG76BH8iJzVEdoHOt9UFsUiG6OuTZg+FjRRwqF9/pD4dXjGwGr1eevoH/eFDwk9s38l7PdZwpUViPmUoEUZ0i5aTRIP3AmFfpApn2Fegw==',key_name='tempest-keypair-742596868',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5e0181762094bd69c9ace796ad893df',ramdisk_id='',reservation_id='r-s799svrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1195989046',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1195989046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354173887a794de284f3961995a9eafb',uuid=546b1a78-e8e9-40ac-ad39-c4eaa1539f91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Converting VIF {"id": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "address": "fa:16:3e:9e:45:44", "network": {"id": "156a321e-54e7-4c4b-a201-24ca5dbad218", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-648857665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5e0181762094bd69c9ace796ad893df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ded7d3-ee", "ovs_interfaceid": "d0ded7d3-ee25-4b88-81d7-e74f82502ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:45:44,bridge_name='br-int',has_traffic_filtering=True,id=d0ded7d3-ee25-4b88-81d7-e74f82502ea1,network=Network(156a321e-54e7-4c4b-a201-24ca5dbad218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ded7d3-ee') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG os_vif [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:45:44,bridge_name='br-int',has_traffic_filtering=True,id=d0ded7d3-ee25-4b88-81d7-e74f82502ea1,network=Network(156a321e-54e7-4c4b-a201-24ca5dbad218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ded7d3-ee') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ded7d3-ee, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=405f7dfc-b1dc-4e37-93e4-ced278be07e1) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:41 user nova-compute[75020]: INFO os_vif [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:45:44,bridge_name='br-int',has_traffic_filtering=True,id=d0ded7d3-ee25-4b88-81d7-e74f82502ea1,network=Network(156a321e-54e7-4c4b-a201-24ca5dbad218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ded7d3-ee')
Nov 30 10:51:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Deleting instance files /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91_del
Nov 30 10:51:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Deletion of /opt/stack/data/nova/instances/546b1a78-e8e9-40ac-ad39-c4eaa1539f91_del complete
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:41 user nova-compute[75020]: INFO nova.compute.manager [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 30 10:51:41 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:51:41 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Instance destroyed successfully.
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.objects.instance [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lazy-loading 'resources' on Instance uuid f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-737307002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-737307002',id=9,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC32ggNNc4ydyH/fUIwM3dMiIIlokdQWXfObdTBcH30ODWMsDZLs4Sik98UFFupit3byxOyEjRGtzhK6P42NtWGPefJUhJt4O1MwH6v5+yHFuqwzFftFvSSI7HtvyHsWuw==',key_name='tempest-keypair-104975548',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941912a981d343bfa3e50a94195ec953',ramdisk_id='',reservation_id='r-ybr0s55l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1620533068',owner_user_name='tempest-TaggedAttachmentsTest-1620533068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4aa8049f42b46e5b5b8f894c56927be',uuid=f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converting VIF {"id": "e6718122-9240-4368-987f-7557ca0ed04a", "address": "fa:16:3e:dc:cd:4e", "network": {"id": "5c8922df-ae24-4441-810f-697d6b1fbcff", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1109161245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941912a981d343bfa3e50a94195ec953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6718122-92", "ovs_interfaceid": "e6718122-9240-4368-987f-7557ca0ed04a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:cd:4e,bridge_name='br-int',has_traffic_filtering=True,id=e6718122-9240-4368-987f-7557ca0ed04a,network=Network(5c8922df-ae24-4441-810f-697d6b1fbcff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6718122-92') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG os_vif [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:cd:4e,bridge_name='br-int',has_traffic_filtering=True,id=e6718122-9240-4368-987f-7557ca0ed04a,network=Network(5c8922df-ae24-4441-810f-697d6b1fbcff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6718122-92') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6718122-92, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a86e0af-3dc9-4082-9983-be079edb0a65) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: INFO os_vif [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:cd:4e,bridge_name='br-int',has_traffic_filtering=True,id=e6718122-9240-4368-987f-7557ca0ed04a,network=Network(5c8922df-ae24-4441-810f-697d6b1fbcff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6718122-92')
Nov 30 10:51:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Deleting instance files /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf_del
Nov 30 10:51:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Deletion of /opt/stack/data/nova/instances/f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf_del complete
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:42 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Took 0.99 seconds to deallocate network for instance.
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-26f91eff-b998-4ff1-9cf6-6e696a637711 req-b4158de4-56d8-4e01-830b-298c5b356327 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-26f91eff-b998-4ff1-9cf6-6e696a637711 req-b4158de4-56d8-4e01-830b-298c5b356327 service nova] Acquiring lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-26f91eff-b998-4ff1-9cf6-6e696a637711 req-b4158de4-56d8-4e01-830b-298c5b356327 service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-26f91eff-b998-4ff1-9cf6-6e696a637711 req-b4158de4-56d8-4e01-830b-298c5b356327 service nova] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-26f91eff-b998-4ff1-9cf6-6e696a637711 req-b4158de4-56d8-4e01-830b-298c5b356327 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] No waiting events found dispatching network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:42 user nova-compute[75020]: WARNING nova.compute.manager [req-26f91eff-b998-4ff1-9cf6-6e696a637711 req-b4158de4-56d8-4e01-830b-298c5b356327 service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received unexpected event network-vif-plugged-e6718122-9240-4368-987f-7557ca0ed04a for instance with vm_state active and task_state deleting.
Nov 30 10:51:42 user nova-compute[75020]: INFO nova.compute.manager [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Took 2.72 seconds to destroy the instance on the hypervisor.
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] [instance: 546b1a78-e8e9-40ac-ad39-c4eaa1539f91] Received event network-vif-deleted-d0ded7d3-ee25-4b88-81d7-e74f82502ea1 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] No waiting events found dispatching network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:45 user nova-compute[75020]: WARNING nova.compute.manager [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received unexpected event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c for instance with vm_state building and task_state spawning.
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] No waiting events found dispatching network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:45 user nova-compute[75020]: WARNING nova.compute.manager [req-b90d6396-616e-4f6f-aca0-0fe05b15221b req-dea05721-0839-4d03-aefd-88a61dd4d55b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received unexpected event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c for instance with vm_state building and task_state spawning.
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:45 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:45 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7590MB free_disk=25.409088134765625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:45 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance spawned successfully.
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:51:45 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Took 2.32 seconds to deallocate network for instance.
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:45 user nova-compute[75020]: INFO nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Took 7.97 seconds to spawn the instance on the hypervisor.
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:51:45 user nova-compute[75020]: INFO nova.compute.manager [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Took 8.90 seconds to build instance.
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.590s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.353s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-346b2ce0-f80e-4633-a1dd-6564440b3b8b req-13a65021-5c4d-4eb4-9104-b1f12e04bf0b service nova] [instance: f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf] Received event network-vif-deleted-e6718122-9240-4368-987f-7557ca0ed04a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28e5366b-1cfe-49d0-846d-408b19261b49 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.020s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:45 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Deleted allocations for instance 546b1a78-e8e9-40ac-ad39-c4eaa1539f91
Nov 30 10:51:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e8f97ee-99c0-4c52-89a9-f131a6ecdafb tempest-VolumesAssistedSnapshotsTest-1195989046 tempest-VolumesAssistedSnapshotsTest-1195989046-project-member] Lock "546b1a78-e8e9-40ac-ad39-c4eaa1539f91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.647s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 88815763-252f-4506-aa0c-5524e8b96e08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77a73463-ea12-43c3-83a4-803f4a535010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: WARNING nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a4614f08-1c9b-4c2c-b541-3cae09a4d61c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a709433f-c094-4726-8498-c508e14f9d54 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:51:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:51:46 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:51:46 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:51:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:51:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.838s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:46 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Deleted allocations for instance f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf
Nov 30 10:51:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-83483220-b653-499a-840c-6476bda81e8d tempest-TaggedAttachmentsTest-1620533068 tempest-TaggedAttachmentsTest-1620533068-project-member] Lock "f9e1770d-b1f0-47ae-9fe5-c2c60ab3aeaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.207s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:51:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: a709433f-c094-4726-8498-c508e14f9d54] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 30 10:51:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:51:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updating instance_info_cache with network_info: [{"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-88815763-252f-4506-aa0c-5524e8b96e08" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquired lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'info_cache' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:48 user nova-compute[75020]: DEBUG nova.objects.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating instance_info_cache with network_info: [{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Releasing lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:51:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance destroyed successfully.
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'resources' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.objects.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_vif [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3370635-c4, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adee627f-0bcc-4a71-8ce7-66ff0c40701e) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:49 user nova-compute[75020]: INFO os_vif [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4')
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHZvTnaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:51:49 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[998cd79e-fe8e-489a-a836-30f5315f88d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:51:49 user nova-compute[75020]: No targets found.
Nov 30 10:51:49 user nova-compute[75020]: iSNS:
Nov 30 10:51:49 user nova-compute[75020]: No targets found.
Nov 30 10:51:49 user nova-compute[75020]: STATIC:
Nov 30 10:51:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a
Nov 30 10:51:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:51:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:51:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:51:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:51:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:51:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:51:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:51:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:51:49 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:51:49 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:51:49 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:51:49 user nova-compute[75020]: FIRMWARE:
Nov 30 10:51:49 user nova-compute[75020]: No targets found.
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:51:49 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:51:49 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca7e0eb-bcb8-42cc-bc8a-4d88507ec95e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9088ade-b970-429b-bb79-6b71488e8dc9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88659360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5'): ({'sdf'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Removing single pathed devices sdf {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bb8b25-565c-4772-8789-99221dd94d45]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce815c26-2aec-46c1-bb3b-60ae1ecc86d1]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flushing IO for device /dev/sdf {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[16662b53-ffda-4f10-8310-15041891176c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b8e39-6efc-4969-a733-077f3debadfd]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] SCSI volumes sdf have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[795122a8-5819-4208-968e-8583cb1d039c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.158s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f15958-ce3e-41c6-b368-6e59ceb34606]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260]
Nov 30 10:51:49 user nova-compute[75020]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260] successful.
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8216cd39-60aa-4a9b-9338-ad3206dec567]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== disconnect_volume: return (434ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Start _get_guest_xml network_info=[{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'b0439567-412b-4fec-bcbb-f418717c1a88', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHZvTnaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '829d8ebf-f5d9-4c51-80d1-fb6c40b1a699', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0e9c986-bdff-4207-be17-4e996343bee5', 'serial': 'c0e9c986-bdff-4207-be17-4e996343bee5'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'numa_topology' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.objects.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:51:49 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:49 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.objects.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHZvTnaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:51:49 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:51:49 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:51:49 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[021dfd83-5222-4173-b634-a56833cf7f22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:51:49 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c936d2-a05d-4afe-a2c2-13c00bd1e247]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5] added
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7f6207-73e2-422f-8835-c0686aee8ab7]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[09963b79-aa39-42e8-aaf0-b8054ea91c16]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHZvTnaV {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHZvTnaV" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[792aabe2-0ae0-44c0-ab10-dd5b085b4fc6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHZvTnaV'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88b738b-2167-46d3-8457-021f182128dd]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee7f19e-71f4-46cc-8ce5-cdf2396e5c02]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3c0d78-7e06-4f7b-852f-5432e9a0a87d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260]
Nov 30 10:51:49 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260] successful.
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97815ec-a890-4358-89e5-0f43ad2bad79]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b45e3d-c2c9-4a48-a847-de3db3c0962e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:51:49 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:51:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f371b4a-7436-4bf6-8367-9ce7894d6bb9]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:51:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHZvTnaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23339346235393337', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339346235393337', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'pci_devices' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.objects.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:51:51 user nova-compute[75020]:   <uuid>829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</uuid>
Nov 30 10:51:51 user nova-compute[75020]:   <name>instance-00000002</name>
Nov 30 10:51:51 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:51:51 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:51:51 user nova-compute[75020]:   <metadata>
Nov 30 10:51:51 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:51:51 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:51:51 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeTestJSON-server-885363355</nova:name>
Nov 30 10:51:51 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:51:49</nova:creationTime>
Nov 30 10:51:51 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:51:51 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:51:51 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:51:51 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:51:51 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:51:51 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:51:51 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:51:51 user nova-compute[75020]:       <nova:owner>
Nov 30 10:51:51 user nova-compute[75020]:         <nova:user uuid="007e7cb60a1540c0a4168b27b2c92e0b">tempest-AttachVolumeTestJSON-1562861090-project-member</nova:user>
Nov 30 10:51:51 user nova-compute[75020]:         <nova:project uuid="c2765886644e4b5eb42a29eb8c0a82e1">tempest-AttachVolumeTestJSON-1562861090</nova:project>
Nov 30 10:51:51 user nova-compute[75020]:       </nova:owner>
Nov 30 10:51:51 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:51:51 user nova-compute[75020]:       <nova:ports>
Nov 30 10:51:51 user nova-compute[75020]:         <nova:port uuid="d3370635-c4d4-4dc7-8a3c-a3dd2756dff0">
Nov 30 10:51:51 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 10:51:51 user nova-compute[75020]:         </nova:port>
Nov 30 10:51:51 user nova-compute[75020]:       </nova:ports>
Nov 30 10:51:51 user nova-compute[75020]:     </nova:instance>
Nov 30 10:51:51 user nova-compute[75020]:   </metadata>
Nov 30 10:51:51 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:51:51 user nova-compute[75020]:     <system>
Nov 30 10:51:51 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:51:51 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:51:51 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:51:51 user nova-compute[75020]:       <entry name="serial">829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</entry>
Nov 30 10:51:51 user nova-compute[75020]:       <entry name="uuid">829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</entry>
Nov 30 10:51:51 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:51:51 user nova-compute[75020]:     </system>
Nov 30 10:51:51 user nova-compute[75020]:   </sysinfo>
Nov 30 10:51:51 user nova-compute[75020]:   <os>
Nov 30 10:51:51 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:51:51 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:51:51 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:51:51 user nova-compute[75020]:   </os>
Nov 30 10:51:51 user nova-compute[75020]:   <features>
Nov 30 10:51:51 user nova-compute[75020]:     <acpi/>
Nov 30 10:51:51 user nova-compute[75020]:     <apic/>
Nov 30 10:51:51 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:51:51 user nova-compute[75020]:   </features>
Nov 30 10:51:51 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:51:51 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:51:51 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:51:51 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:51:51 user nova-compute[75020]:   </clock>
Nov 30 10:51:51 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:51:51 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:51:51 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:51:51 user nova-compute[75020]:   </cpu>
Nov 30 10:51:51 user nova-compute[75020]:   <devices>
Nov 30 10:51:51 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:51:51 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:51:51 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk"/>
Nov 30 10:51:51 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:51:51 user nova-compute[75020]:     </disk>
Nov 30 10:51:51 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:51:51 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:51:51 user nova-compute[75020]:       <source dev="/dev/sdd"/>
Nov 30 10:51:51 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 10:51:51 user nova-compute[75020]:       <serial>c0e9c986-bdff-4207-be17-4e996343bee5</serial>
Nov 30 10:51:51 user nova-compute[75020]:     </disk>
Nov 30 10:51:51 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:51:51 user nova-compute[75020]:       <mac address="fa:16:3e:54:c0:d7"/>
Nov 30 10:51:51 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:51 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:51:51 user nova-compute[75020]:       <target dev="tapd3370635-c4"/>
Nov 30 10:51:51 user nova-compute[75020]:     </interface>
Nov 30 10:51:51 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:51:51 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/console.log" append="off"/>
Nov 30 10:51:51 user nova-compute[75020]:     </serial>
Nov 30 10:51:51 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:51:51 user nova-compute[75020]:     <video>
Nov 30 10:51:51 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:51:51 user nova-compute[75020]:     </video>
Nov 30 10:51:51 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:51:51 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:51:51 user nova-compute[75020]:     </rng>
Nov 30 10:51:51 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:51:51 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:51:51 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:51:51 user nova-compute[75020]:     </memballoon>
Nov 30 10:51:51 user nova-compute[75020]:   </devices>
Nov 30 10:51:51 user nova-compute[75020]: </domain>
Nov 30 10:51:51 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'trusted_certs' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.objects.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Cannot resize image /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'migration_context' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.objects.base [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG os_vif [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1f96adc-4f30-551c-89e9-e72083986872', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3370635-c4, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3370635-c4, col_values=(('qos', UUID('33b155e7-3fe9-4294-8a33-3f6196b10ea8')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3370635-c4, col_values=(('external_ids', {'iface-id': 'd3370635-c4d4-4dc7-8a3c-a3dd2756dff0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:c0:d7', 'vm-uuid': '829d8ebf-f5d9-4c51-80d1-fb6c40b1a699'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:51:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:51 user nova-compute[75020]: INFO os_vif [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4')
Nov 30 10:51:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-f12ad907-a9d5-4c3c-9881-ced396f23415 req-cfe468f4-7764-4a66-a578-89732837b22b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f12ad907-a9d5-4c3c-9881-ced396f23415 req-cfe468f4-7764-4a66-a578-89732837b22b service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f12ad907-a9d5-4c3c-9881-ced396f23415 req-cfe468f4-7764-4a66-a578-89732837b22b service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f12ad907-a9d5-4c3c-9881-ced396f23415 req-cfe468f4-7764-4a66-a578-89732837b22b service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-f12ad907-a9d5-4c3c-9881-ced396f23415 req-cfe468f4-7764-4a66-a578-89732837b22b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:53 user nova-compute[75020]: WARNING nova.compute.manager [req-f12ad907-a9d5-4c3c-9881-ced396f23415 req-cfe468f4-7764-4a66-a578-89732837b22b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state stopped and task_state powering-on.
Nov 30 10:51:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:55 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:51:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance rebooted successfully.
Nov 30 10:51:55 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f536a61e-f551-4b2c-90c0-b0dbc6c3e284 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:51:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5cd552ab-8458-4a9f-b70d-225f3cfab5ac req-38d996ab-d02a-44c8-88c3-2b35f45a6be1 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:51:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5cd552ab-8458-4a9f-b70d-225f3cfab5ac req-38d996ab-d02a-44c8-88c3-2b35f45a6be1 service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:51:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5cd552ab-8458-4a9f-b70d-225f3cfab5ac req-38d996ab-d02a-44c8-88c3-2b35f45a6be1 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:51:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5cd552ab-8458-4a9f-b70d-225f3cfab5ac req-38d996ab-d02a-44c8-88c3-2b35f45a6be1 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:51:55 user nova-compute[75020]: DEBUG nova.compute.manager [req-5cd552ab-8458-4a9f-b70d-225f3cfab5ac req-38d996ab-d02a-44c8-88c3-2b35f45a6be1 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:51:55 user nova-compute[75020]: WARNING nova.compute.manager [req-5cd552ab-8458-4a9f-b70d-225f3cfab5ac req-38d996ab-d02a-44c8-88c3-2b35f45a6be1 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state stopped and task_state powering-on.
Nov 30 10:51:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:51:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'pci_requests' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'numa_topology' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:52:02 user nova-compute[75020]: INFO nova.compute.claims [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Claim successful on node user
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:02 user nova-compute[75020]: INFO nova.compute.manager [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Detaching volume 4fb6d790-61c7-4b90-afd5-bc1d316ece3a
Nov 30 10:52:02 user nova-compute[75020]: INFO nova.network.neutron [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 10:52:02 user nova-compute[75020]: INFO nova.virt.block_device [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attempting to driver detach volume 4fb6d790-61c7-4b90-afd5-bc1d316ece3a from mountpoint /dev/vdb
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Attempting to detach device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:52:02 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:52:02 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:52:02 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:52:02 user nova-compute[75020]:   <serial>4fb6d790-61c7-4b90-afd5-bc1d316ece3a</serial>
Nov 30 10:52:02 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:52:02 user nova-compute[75020]: </disk>
Nov 30 10:52:02 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:52:02 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully detached device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the persistent domain config.
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:52:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:52:02 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:52:02 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:52:02 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:52:02 user nova-compute[75020]:   <serial>4fb6d790-61c7-4b90-afd5-bc1d316ece3a</serial>
Nov 30 10:52:02 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:52:02 user nova-compute[75020]: </disk>
Nov 30 10:52:02 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquired lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-b98073e8-bdd5-4fa9-b7f1-cc234aadcff1 req-6403c2e2-9cde-45a7-a70e-ee6fbeb0947a service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-changed-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-b98073e8-bdd5-4fa9-b7f1-cc234aadcff1 req-6403c2e2-9cde-45a7-a70e-ee6fbeb0947a service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Refreshing instance network info cache due to event network-changed-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b98073e8-bdd5-4fa9-b7f1-cc234aadcff1 req-6403c2e2-9cde-45a7-a70e-ee6fbeb0947a service nova] Acquiring lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating instance_info_cache with network_info: [{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Releasing lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:52:04 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Creating image(s)
Nov 30 10:52:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'trusted_certs' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b98073e8-bdd5-4fa9-b7f1-cc234aadcff1 req-6403c2e2-9cde-45a7-a70e-ee6fbeb0947a service nova] Acquired lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG nova.network.neutron [req-b98073e8-bdd5-4fa9-b7f1-cc234aadcff1 req-6403c2e2-9cde-45a7-a70e-ee6fbeb0947a service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Refreshing network info cache for port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG nova.objects.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<a709433f-c094-4726-8498-c508e14f9d54> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "af2ec5b5de3cfbe64c63db2c1f737b160c0215c1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "af2ec5b5de3cfbe64c63db2c1f737b160c0215c1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:05 user nova-compute[75020]: DEBUG nova.virt.images [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] 9c784e77-a3c9-47fd-9c2c-69e71413cd08 was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 10:52:05 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:52:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1.part /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-b98073e8-bdd5-4fa9-b7f1-cc234aadcff1 req-6403c2e2-9cde-45a7-a70e-ee6fbeb0947a service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updated VIF entry in instance network info cache for port 4b71bc40-4d85-4dd0-8a0d-f215a4fc070f. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-b98073e8-bdd5-4fa9-b7f1-cc234aadcff1 req-6403c2e2-9cde-45a7-a70e-ee6fbeb0947a service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating instance_info_cache with network_info: [{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b98073e8-bdd5-4fa9-b7f1-cc234aadcff1 req-6403c2e2-9cde-45a7-a70e-ee6fbeb0947a service nova] Releasing lock "refresh_cache-a709433f-c094-4726-8498-c508e14f9d54" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1.part /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1.converted" returned: 0 in 0.662s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "af2ec5b5de3cfbe64c63db2c1f737b160c0215c1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.236s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1 --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "af2ec5b5de3cfbe64c63db2c1f737b160c0215c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "af2ec5b5de3cfbe64c63db2c1f737b160c0215c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1 --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1,backing_fmt=raw /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1,backing_fmt=raw /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk 1073741824" returned: 0 in 0.047s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "af2ec5b5de3cfbe64c63db2c1f737b160c0215c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'migration_context' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG nova.objects.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<a709433f-c094-4726-8498-c508e14f9d54> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:07 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Rebasing disk image.
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 -F raw /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 -F raw /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk" returned: 0 in 2.753s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Ensure instance console log exists: /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Start _get_guest_xml network_info=[{"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='4321557872c74a1dbb0b5b14da2afe9b',container_format='bare',created_at=2023-11-30T10:49:47Z,direct_url=<?>,disk_format='qcow2',id=9c784e77-a3c9-47fd-9c2c-69e71413cd08,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1075430230-shelved',owner='0b0cce29854643d0b730dc664697dee7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T10:49:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '0d8bb032-e7a6-4150-a021-d3b13c07db62', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iorwKHEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a709433f-c094-4726-8498-c508e14f9d54', 'attached_at': '', 'detached_at': '', 'volume_id': '6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb', 'serial': '6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:52:10 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:52:10 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4321557872c74a1dbb0b5b14da2afe9b',container_format='bare',created_at=2023-11-30T10:49:47Z,direct_url=<?>,disk_format='qcow2',id=9c784e77-a3c9-47fd-9c2c-69e71413cd08,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1075430230-shelved',owner='0b0cce29854643d0b730dc664697dee7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T10:49:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'vcpu_model' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.objects.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<a709433f-c094-4726-8498-c508e14f9d54> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iorwKHEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:52:10 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:52:10 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:52:10 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4eae1-ee3f-44ab-8dd7-75b3b4e4bc9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:52:10 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[82020806-718a-4fc3-92ca-5038117c7e1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb] added
Nov 30 10:52:10 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b7c785-c79b-415c-ab82-8da5fe0b3ea1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a736ce-b50e-4cf7-8c24-20b4379b6b50]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iorwKHEj {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iorwKHEj" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c09161-a7b8-4a2e-9522-db1193279b23]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iorwKHEj'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3833a65d-11cd-4e2b-98b5-4b5c87364071]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d096e185-8319-40db-a9d1-98034e3609dc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:52:10 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:52:10 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c8b8f9-2738-41fe-b148-0cf4e319114e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb, portal: 172.16.0.220,3260]
Nov 30 10:52:10 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb, portal: 172.16.0.220,3260] successful.
Nov 30 10:52:10 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfe827-536e-4588-911b-6af1174496da]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7197ea-6d06-47cd-b97b-b25ebb58063f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:52:10 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:52:10 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:52:10 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.032s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6587629e-0e77-4a4d-97c3-b775fbe53dfc]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:52:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iorwKHEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26234383636623636', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234383636623636', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1075430230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1075430230',id=5,image_ref='9c784e77-a3c9-47fd-9c2c-69e71413cd08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1856789779',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-kuebsqbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member',shelved_at='2023-11-30T10:49:52.545824',shelved_host='user',shelved_image_id='9c784e77-a3c9-47fd-9c2c-69e71413cd08'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=a709433f-c094-4726-8498-c508e14f9d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'pci_devices' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.objects.base [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<a709433f-c094-4726-8498-c508e14f9d54> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:52:11 user nova-compute[75020]:   <uuid>a709433f-c094-4726-8498-c508e14f9d54</uuid>
Nov 30 10:52:11 user nova-compute[75020]:   <name>instance-00000005</name>
Nov 30 10:52:11 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:52:11 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:52:11 user nova-compute[75020]:   <metadata>
Nov 30 10:52:11 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:52:11 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:52:11 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1075430230</nova:name>
Nov 30 10:52:11 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:52:10</nova:creationTime>
Nov 30 10:52:11 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:52:11 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:52:11 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:52:11 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:52:11 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:52:11 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:52:11 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:52:11 user nova-compute[75020]:       <nova:owner>
Nov 30 10:52:11 user nova-compute[75020]:         <nova:user uuid="5d431a8177f54de08c3d0c03a3c9ff1e">tempest-AttachVolumeShelveTestJSON-1553674360-project-member</nova:user>
Nov 30 10:52:11 user nova-compute[75020]:         <nova:project uuid="0b0cce29854643d0b730dc664697dee7">tempest-AttachVolumeShelveTestJSON-1553674360</nova:project>
Nov 30 10:52:11 user nova-compute[75020]:       </nova:owner>
Nov 30 10:52:11 user nova-compute[75020]:       <nova:root type="image" uuid="9c784e77-a3c9-47fd-9c2c-69e71413cd08"/>
Nov 30 10:52:11 user nova-compute[75020]:       <nova:ports>
Nov 30 10:52:11 user nova-compute[75020]:         <nova:port uuid="4b71bc40-4d85-4dd0-8a0d-f215a4fc070f">
Nov 30 10:52:11 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 10:52:11 user nova-compute[75020]:         </nova:port>
Nov 30 10:52:11 user nova-compute[75020]:       </nova:ports>
Nov 30 10:52:11 user nova-compute[75020]:     </nova:instance>
Nov 30 10:52:11 user nova-compute[75020]:   </metadata>
Nov 30 10:52:11 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:52:11 user nova-compute[75020]:     <system>
Nov 30 10:52:11 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:52:11 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:52:11 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:52:11 user nova-compute[75020]:       <entry name="serial">a709433f-c094-4726-8498-c508e14f9d54</entry>
Nov 30 10:52:11 user nova-compute[75020]:       <entry name="uuid">a709433f-c094-4726-8498-c508e14f9d54</entry>
Nov 30 10:52:11 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:52:11 user nova-compute[75020]:     </system>
Nov 30 10:52:11 user nova-compute[75020]:   </sysinfo>
Nov 30 10:52:11 user nova-compute[75020]:   <os>
Nov 30 10:52:11 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:52:11 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:52:11 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:52:11 user nova-compute[75020]:   </os>
Nov 30 10:52:11 user nova-compute[75020]:   <features>
Nov 30 10:52:11 user nova-compute[75020]:     <acpi/>
Nov 30 10:52:11 user nova-compute[75020]:     <apic/>
Nov 30 10:52:11 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:52:11 user nova-compute[75020]:   </features>
Nov 30 10:52:11 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:52:11 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:52:11 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:52:11 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:52:11 user nova-compute[75020]:   </clock>
Nov 30 10:52:11 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:52:11 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:52:11 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:52:11 user nova-compute[75020]:   </cpu>
Nov 30 10:52:11 user nova-compute[75020]:   <devices>
Nov 30 10:52:11 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:52:11 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:52:11 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk"/>
Nov 30 10:52:11 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:52:11 user nova-compute[75020]:     </disk>
Nov 30 10:52:11 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:52:11 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:52:11 user nova-compute[75020]:       <source dev="/dev/sde"/>
Nov 30 10:52:11 user nova-compute[75020]:       <target dev="vdc" bus="virtio"/>
Nov 30 10:52:11 user nova-compute[75020]:       <serial>6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb</serial>
Nov 30 10:52:11 user nova-compute[75020]:     </disk>
Nov 30 10:52:11 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:52:11 user nova-compute[75020]:       <mac address="fa:16:3e:c9:00:aa"/>
Nov 30 10:52:11 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:52:11 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:52:11 user nova-compute[75020]:       <target dev="tap4b71bc40-4d"/>
Nov 30 10:52:11 user nova-compute[75020]:     </interface>
Nov 30 10:52:11 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:52:11 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/console.log" append="off"/>
Nov 30 10:52:11 user nova-compute[75020]:     </serial>
Nov 30 10:52:11 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:52:11 user nova-compute[75020]:     <video>
Nov 30 10:52:11 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:52:11 user nova-compute[75020]:     </video>
Nov 30 10:52:11 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:52:11 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:52:11 user nova-compute[75020]:     </rng>
Nov 30 10:52:11 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:52:11 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:52:11 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:52:11 user nova-compute[75020]:     </memballoon>
Nov 30 10:52:11 user nova-compute[75020]:   </devices>
Nov 30 10:52:11 user nova-compute[75020]: </domain>
Nov 30 10:52:11 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1075430230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1075430230',id=5,image_ref='9c784e77-a3c9-47fd-9c2c-69e71413cd08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1856789779',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-kuebsqbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member',shelved_at='2023-11-30T10:49:52.545824',shelved_host='user',shelved_image_id='9c784e77-a3c9-47fd-9c2c-69e71413cd08'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=a709433f-c094-4726-8498-c508e14f9d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG os_vif [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79ef737b-349b-5646-8ca3-e24a1b62f14b', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b71bc40-4d, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b71bc40-4d, col_values=(('qos', UUID('784927de-620e-4e7b-bfa5-e440f947144f')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b71bc40-4d, col_values=(('external_ids', {'iface-id': '4b71bc40-4d85-4dd0-8a0d-f215a4fc070f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:00:aa', 'vm-uuid': 'a709433f-c094-4726-8498-c508e14f9d54'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:11 user nova-compute[75020]: INFO os_vif [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d')
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:52:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No VIF found with MAC fa:16:3e:c9:00:aa, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:52:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:52:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:52:15 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance spawned successfully.
Nov 30 10:52:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:52:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d6aae529-0d1d-4813-9377-c9739ac7d152 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.939s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-abb25033-fde2-40bf-812d-8e9c9c2d80be req-4414375f-20e0-4180-a4a1-4a027b044b94 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-abb25033-fde2-40bf-812d-8e9c9c2d80be req-4414375f-20e0-4180-a4a1-4a027b044b94 service nova] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-abb25033-fde2-40bf-812d-8e9c9c2d80be req-4414375f-20e0-4180-a4a1-4a027b044b94 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-abb25033-fde2-40bf-812d-8e9c9c2d80be req-4414375f-20e0-4180-a4a1-4a027b044b94 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-abb25033-fde2-40bf-812d-8e9c9c2d80be req-4414375f-20e0-4180-a4a1-4a027b044b94 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] No waiting events found dispatching network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:52:18 user nova-compute[75020]: WARNING nova.compute.manager [req-abb25033-fde2-40bf-812d-8e9c9c2d80be req-4414375f-20e0-4180-a4a1-4a027b044b94 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received unexpected event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f for instance with vm_state active and task_state None.
Nov 30 10:52:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-07686da8-3d3c-43e3-9b1d-f3cd5ca93bff req-7b9826b7-5973-4167-8176-aac0079c6b1b service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07686da8-3d3c-43e3-9b1d-f3cd5ca93bff req-7b9826b7-5973-4167-8176-aac0079c6b1b service nova] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07686da8-3d3c-43e3-9b1d-f3cd5ca93bff req-7b9826b7-5973-4167-8176-aac0079c6b1b service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07686da8-3d3c-43e3-9b1d-f3cd5ca93bff req-7b9826b7-5973-4167-8176-aac0079c6b1b service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-07686da8-3d3c-43e3-9b1d-f3cd5ca93bff req-7b9826b7-5973-4167-8176-aac0079c6b1b service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] No waiting events found dispatching network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:52:20 user nova-compute[75020]: WARNING nova.compute.manager [req-07686da8-3d3c-43e3-9b1d-f3cd5ca93bff req-7b9826b7-5973-4167-8176-aac0079c6b1b service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received unexpected event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f for instance with vm_state active and task_state None.
Nov 30 10:52:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:23 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 is timed out.
Nov 30 10:52:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully detached device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the live domain config.
Nov 30 10:52:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRePSNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:52:23 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe9cdd2-975f-4a8a-9251-6b7adf70efd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:52:23 user nova-compute[75020]: No targets found.
Nov 30 10:52:23 user nova-compute[75020]: iSNS:
Nov 30 10:52:23 user nova-compute[75020]: No targets found.
Nov 30 10:52:23 user nova-compute[75020]: STATIC:
Nov 30 10:52:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a
Nov 30 10:52:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:52:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:52:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:52:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:52:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:52:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:52:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:52:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:52:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb
Nov 30 10:52:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:52:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:52:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:52:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:52:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:52:23 user nova-compute[75020]: FIRMWARE:
Nov 30 10:52:23 user nova-compute[75020]: No targets found.
Nov 30 10:52:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:52:23 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:52:23 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[46306e04-86e6-4893-b215-eea336edd313]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3457f4-1447-472f-8bc5-eb995504e1f7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:52:23 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:52:23 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:52:23 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:52:23 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:52:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:52:23 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:52:23 user nova-compute[75020]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a (non-flash)
Nov 30 10:52:23 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:52:23 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:52:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada815b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a42f8-a461-4cba-898b-750236eb1cb2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f03ed18-f8fa-4b47-b07b-75bc35d4e48d]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c3a43-8cfc-4a00-bd36-50c66d981391]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3363940-fd0f-4d2e-a55c-ac1c8a61509e]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da47aaf-f44e-453e-b2ce-bc7a9e97e319]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8a0ca1-5a16-4a5d-abff-19bfefc182be]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a, portal: 172.16.0.220,3260]
Nov 30 10:52:23 user nova-compute[75020]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a, portal: 172.16.0.220,3260] successful.
Nov 30 10:52:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb6d790-61c7-4b90-afd5-bc1d316ece3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c992d-471a-4205-8780-2f1317675ca3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== disconnect_volume: return (333ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:52:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:52:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:24 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b3e97e37-63d6-4c40-b08a-82fe555587c9 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.188s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:52:30 user nova-compute[75020]: INFO nova.compute.claims [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Claim successful on node user
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:52:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.policy [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da395ea928bf46038b99ad9a07316e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55004ba1e4574301bb3719f8b844e4b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:52:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Creating image(s)
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.252s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk 1073741824" returned: 0 in 0.057s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Successfully created port: 3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Cannot resize image /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Ensure instance console log exists: /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Successfully updated port: 3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:52:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquired lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:52:32 user nova-compute[75020]: DEBUG nova.compute.manager [req-ab4680f8-2071-4bdb-855c-cceddacb1d5e req-d161625f-3664-4c1e-888f-40e0bcdec259 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-changed-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:32 user nova-compute[75020]: DEBUG nova.compute.manager [req-ab4680f8-2071-4bdb-855c-cceddacb1d5e req-d161625f-3664-4c1e-888f-40e0bcdec259 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Refreshing instance network info cache due to event network-changed-3a7eecf5-e982-408c-a25e-885e6d940868. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ab4680f8-2071-4bdb-855c-cceddacb1d5e req-d161625f-3664-4c1e-888f-40e0bcdec259 service nova] Acquiring lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.network.neutron [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating instance_info_cache with network_info: [{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Releasing lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance network_info: |[{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ab4680f8-2071-4bdb-855c-cceddacb1d5e req-d161625f-3664-4c1e-888f-40e0bcdec259 service nova] Acquired lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.network.neutron [req-ab4680f8-2071-4bdb-855c-cceddacb1d5e req-d161625f-3664-4c1e-888f-40e0bcdec259 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Refreshing network info cache for port 3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Start _get_guest_xml network_info=[{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:52:33 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:52:33 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1528753811',display_name='tempest-ServerStableDeviceRescueTest-server-1528753811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1528753811',id=17,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkAChtDxffRIlPGYFGRuJtAVkekQcw1uV8ePrIIuQr5SosrYxX3CAafIjEH3mP8UFojTtie6pHZd29rHhWQHbfV+u8DDejqZQRsBEATIYQ92TlesQyXERYqkULA9v27yQ==',key_name='tempest-keypair-1223282536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55004ba1e4574301bb3719f8b844e4b3',ramdisk_id='',reservation_id='r-itm15rol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1531770868',owner_user_name='tempest-ServerStableDeviceRescueTest-1531770868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da395ea928bf46038b99ad9a07316e0c',uuid=fae5310f-5516-4349-ad31-4df9453171a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Converting VIF {"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:db,bridge_name='br-int',has_traffic_filtering=True,id=3a7eecf5-e982-408c-a25e-885e6d940868,network=Network(606a02ce-3a02-4189-b153-058024e588a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7eecf5-e9') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.objects.instance [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'pci_devices' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:52:33 user nova-compute[75020]:   <uuid>fae5310f-5516-4349-ad31-4df9453171a7</uuid>
Nov 30 10:52:33 user nova-compute[75020]:   <name>instance-00000011</name>
Nov 30 10:52:33 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:52:33 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:52:33 user nova-compute[75020]:   <metadata>
Nov 30 10:52:33 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:52:33 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:52:33 user nova-compute[75020]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1528753811</nova:name>
Nov 30 10:52:33 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:52:33</nova:creationTime>
Nov 30 10:52:33 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:52:33 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:52:33 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:52:33 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:52:33 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:52:33 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:52:33 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:52:33 user nova-compute[75020]:       <nova:owner>
Nov 30 10:52:33 user nova-compute[75020]:         <nova:user uuid="da395ea928bf46038b99ad9a07316e0c">tempest-ServerStableDeviceRescueTest-1531770868-project-member</nova:user>
Nov 30 10:52:33 user nova-compute[75020]:         <nova:project uuid="55004ba1e4574301bb3719f8b844e4b3">tempest-ServerStableDeviceRescueTest-1531770868</nova:project>
Nov 30 10:52:33 user nova-compute[75020]:       </nova:owner>
Nov 30 10:52:33 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:52:33 user nova-compute[75020]:       <nova:ports>
Nov 30 10:52:33 user nova-compute[75020]:         <nova:port uuid="3a7eecf5-e982-408c-a25e-885e6d940868">
Nov 30 10:52:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 10:52:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:52:33 user nova-compute[75020]:       </nova:ports>
Nov 30 10:52:33 user nova-compute[75020]:     </nova:instance>
Nov 30 10:52:33 user nova-compute[75020]:   </metadata>
Nov 30 10:52:33 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:52:33 user nova-compute[75020]:     <system>
Nov 30 10:52:33 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:52:33 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:52:33 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:52:33 user nova-compute[75020]:       <entry name="serial">fae5310f-5516-4349-ad31-4df9453171a7</entry>
Nov 30 10:52:33 user nova-compute[75020]:       <entry name="uuid">fae5310f-5516-4349-ad31-4df9453171a7</entry>
Nov 30 10:52:33 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:52:33 user nova-compute[75020]:     </system>
Nov 30 10:52:33 user nova-compute[75020]:   </sysinfo>
Nov 30 10:52:33 user nova-compute[75020]:   <os>
Nov 30 10:52:33 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:52:33 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:52:33 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:52:33 user nova-compute[75020]:   </os>
Nov 30 10:52:33 user nova-compute[75020]:   <features>
Nov 30 10:52:33 user nova-compute[75020]:     <acpi/>
Nov 30 10:52:33 user nova-compute[75020]:     <apic/>
Nov 30 10:52:33 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:52:33 user nova-compute[75020]:   </features>
Nov 30 10:52:33 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:52:33 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:52:33 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:52:33 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:52:33 user nova-compute[75020]:   </clock>
Nov 30 10:52:33 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:52:33 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:52:33 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:52:33 user nova-compute[75020]:   </cpu>
Nov 30 10:52:33 user nova-compute[75020]:   <devices>
Nov 30 10:52:33 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:52:33 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:52:33 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk"/>
Nov 30 10:52:33 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:52:33 user nova-compute[75020]:     </disk>
Nov 30 10:52:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:52:33 user nova-compute[75020]:       <mac address="fa:16:3e:8c:1b:db"/>
Nov 30 10:52:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:52:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:52:33 user nova-compute[75020]:       <target dev="tap3a7eecf5-e9"/>
Nov 30 10:52:33 user nova-compute[75020]:     </interface>
Nov 30 10:52:33 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:52:33 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/console.log" append="off"/>
Nov 30 10:52:33 user nova-compute[75020]:     </serial>
Nov 30 10:52:33 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:52:33 user nova-compute[75020]:     <video>
Nov 30 10:52:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:52:33 user nova-compute[75020]:     </video>
Nov 30 10:52:33 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:52:33 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:52:33 user nova-compute[75020]:     </rng>
Nov 30 10:52:33 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:52:33 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:52:33 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:52:33 user nova-compute[75020]:     </memballoon>
Nov 30 10:52:33 user nova-compute[75020]:   </devices>
Nov 30 10:52:33 user nova-compute[75020]: </domain>
Nov 30 10:52:33 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1528753811',display_name='tempest-ServerStableDeviceRescueTest-server-1528753811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1528753811',id=17,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkAChtDxffRIlPGYFGRuJtAVkekQcw1uV8ePrIIuQr5SosrYxX3CAafIjEH3mP8UFojTtie6pHZd29rHhWQHbfV+u8DDejqZQRsBEATIYQ92TlesQyXERYqkULA9v27yQ==',key_name='tempest-keypair-1223282536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55004ba1e4574301bb3719f8b844e4b3',ramdisk_id='',reservation_id='r-itm15rol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1531770868',owner_user_name='tempest-ServerStableDeviceRescueTest-1531770868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da395ea928bf46038b99ad9a07316e0c',uuid=fae5310f-5516-4349-ad31-4df9453171a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Converting VIF {"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:db,bridge_name='br-int',has_traffic_filtering=True,id=3a7eecf5-e982-408c-a25e-885e6d940868,network=Network(606a02ce-3a02-4189-b153-058024e588a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7eecf5-e9') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG os_vif [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:db,bridge_name='br-int',has_traffic_filtering=True,id=3a7eecf5-e982-408c-a25e-885e6d940868,network=Network(606a02ce-3a02-4189-b153-058024e588a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7eecf5-e9') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba94927b-8f08-5e17-b8b2-7f86d8cfc932', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a7eecf5-e9, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a7eecf5-e9, col_values=(('qos', UUID('a9eef53b-69a8-4fa1-969e-bb5fdfe445b6')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a7eecf5-e9, col_values=(('external_ids', {'iface-id': '3a7eecf5-e982-408c-a25e-885e6d940868', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:1b:db', 'vm-uuid': 'fae5310f-5516-4349-ad31-4df9453171a7'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:33 user nova-compute[75020]: INFO os_vif [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:db,bridge_name='br-int',has_traffic_filtering=True,id=3a7eecf5-e982-408c-a25e-885e6d940868,network=Network(606a02ce-3a02-4189-b153-058024e588a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7eecf5-e9')
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No VIF found with MAC fa:16:3e:8c:1b:db, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.network.neutron [req-ab4680f8-2071-4bdb-855c-cceddacb1d5e req-d161625f-3664-4c1e-888f-40e0bcdec259 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updated VIF entry in instance network info cache for port 3a7eecf5-e982-408c-a25e-885e6d940868. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG nova.network.neutron [req-ab4680f8-2071-4bdb-855c-cceddacb1d5e req-d161625f-3664-4c1e-888f-40e0bcdec259 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating instance_info_cache with network_info: [{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ab4680f8-2071-4bdb-855c-cceddacb1d5e req-d161625f-3664-4c1e-888f-40e0bcdec259 service nova] Releasing lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:52:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:52:35 user nova-compute[75020]: INFO nova.compute.claims [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Claim successful on node user
Nov 30 10:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-eba5626b-efd4-4d4e-9087-03c62c885021 req-6795cc3b-0bbe-4f3b-a32d-f786e333756b service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eba5626b-efd4-4d4e-9087-03c62c885021 req-6795cc3b-0bbe-4f3b-a32d-f786e333756b service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eba5626b-efd4-4d4e-9087-03c62c885021 req-6795cc3b-0bbe-4f3b-a32d-f786e333756b service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eba5626b-efd4-4d4e-9087-03c62c885021 req-6795cc3b-0bbe-4f3b-a32d-f786e333756b service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-eba5626b-efd4-4d4e-9087-03c62c885021 req-6795cc3b-0bbe-4f3b-a32d-f786e333756b service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:52:35 user nova-compute[75020]: WARNING nova.compute.manager [req-eba5626b-efd4-4d4e-9087-03c62c885021 req-6795cc3b-0bbe-4f3b-a32d-f786e333756b service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state building and task_state spawning.
Nov 30 10:52:35 user nova-compute[75020]: INFO nova.compute.manager [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Rescuing
Nov 30 10:52:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquired lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.network.neutron [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.822s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:52:35 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:52:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:52:36 user nova-compute[75020]: INFO nova.virt.block_device [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Booting with volume 8b7b1dc3-77db-4e41-b4b2-8b0b60703870 at /dev/vda
Nov 30 10:52:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating instance_info_cache with network_info: [{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Releasing lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG os_brick.utils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca3a16-0f7f-4cbc-8dc9-0b2b7d47373c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG nova.policy [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9540302fa89436f950812bd909b60a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bb1b67a71e4a2a93627458172d7d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb9a945-8ada-42eb-ae93-51079eea5742]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[431f152c-8c0f-43b2-808b-2316db4ae512]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[144da29a-fc23-4514-b8b4-8ac12b9cfeda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:52:36 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f696bd1-7557-4e68-8085-21bd542c03b7]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG os_brick.utils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating existing volume attachment record: 8c50def1-6ff0-4c14-8a11-eeb2bf244eb6 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-ea1cbe6c-79dd-461b-a5b9-40fb4fc8ddb6 req-02a3e29b-abff-4afe-9787-fd6d76194085 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ea1cbe6c-79dd-461b-a5b9-40fb4fc8ddb6 req-02a3e29b-abff-4afe-9787-fd6d76194085 service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ea1cbe6c-79dd-461b-a5b9-40fb4fc8ddb6 req-02a3e29b-abff-4afe-9787-fd6d76194085 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ea1cbe6c-79dd-461b-a5b9-40fb4fc8ddb6 req-02a3e29b-abff-4afe-9787-fd6d76194085 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-ea1cbe6c-79dd-461b-a5b9-40fb4fc8ddb6 req-02a3e29b-abff-4afe-9787-fd6d76194085 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:52:36 user nova-compute[75020]: WARNING nova.compute.manager [req-ea1cbe6c-79dd-461b-a5b9-40fb4fc8ddb6 req-02a3e29b-abff-4afe-9787-fd6d76194085 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state active and task_state rescuing.
Nov 30 10:52:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance destroyed successfully.
Nov 30 10:52:37 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully created port: a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:52:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Attempting a stable device rescue
Nov 30 10:52:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75020) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 10:52:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance directory exists: not creating {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 10:52:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Creating image(s)
Nov 30 10:52:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "/opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "/opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "/opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "1e6da450debb2f3092d39a6d55d7e477fcf1763b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "1e6da450debb2f3092d39a6d55d7e477fcf1763b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-14bc1865-0e3e-4da6-9ff8-3fc5320b7639 req-bb606c02-fd8f-43a2-bf8a-4dcff87fb3ae service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14bc1865-0e3e-4da6-9ff8-3fc5320b7639 req-bb606c02-fd8f-43a2-bf8a-4dcff87fb3ae service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14bc1865-0e3e-4da6-9ff8-3fc5320b7639 req-bb606c02-fd8f-43a2-bf8a-4dcff87fb3ae service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14bc1865-0e3e-4da6-9ff8-3fc5320b7639 req-bb606c02-fd8f-43a2-bf8a-4dcff87fb3ae service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-14bc1865-0e3e-4da6-9ff8-3fc5320b7639 req-bb606c02-fd8f-43a2-bf8a-4dcff87fb3ae service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:52:38 user nova-compute[75020]: WARNING nova.compute.manager [req-14bc1865-0e3e-4da6-9ff8-3fc5320b7639 req-bb606c02-fd8f-43a2-bf8a-4dcff87fb3ae service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state building and task_state spawning.
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance spawned successfully.
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:52:38 user nova-compute[75020]: INFO nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Took 7.31 seconds to spawn the instance on the hypervisor.
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b.part --force-share --output=json" returned: 0 in 0.320s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.virt.images [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] 0cd05528-244d-421a-865f-655e2c47e44b was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b.part /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:38 user nova-compute[75020]: INFO nova.compute.manager [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Took 8.33 seconds to build instance.
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-df90c110-b672-4f64-aa6a-07044a5806cf tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.455s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b.part /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b.converted" returned: 0 in 0.321s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-627a7948-7074-40ab-b18b-03471e1df979 req-1b3cbf1d-07ce-491a-bf6a-a34575239df4 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-627a7948-7074-40ab-b18b-03471e1df979 req-1b3cbf1d-07ce-491a-bf6a-a34575239df4 service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-627a7948-7074-40ab-b18b-03471e1df979 req-1b3cbf1d-07ce-491a-bf6a-a34575239df4 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-627a7948-7074-40ab-b18b-03471e1df979 req-1b3cbf1d-07ce-491a-bf6a-a34575239df4 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-627a7948-7074-40ab-b18b-03471e1df979 req-1b3cbf1d-07ce-491a-bf6a-a34575239df4 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:52:38 user nova-compute[75020]: WARNING nova.compute.manager [req-627a7948-7074-40ab-b18b-03471e1df979 req-1b3cbf1d-07ce-491a-bf6a-a34575239df4 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state active and task_state rescuing.
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "1e6da450debb2f3092d39a6d55d7e477fcf1763b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.786s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "1e6da450debb2f3092d39a6d55d7e477fcf1763b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "1e6da450debb2f3092d39a6d55d7e477fcf1763b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b --force-share --output=json" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b,backing_fmt=raw /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b,backing_fmt=raw /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue" returned: 0 in 0.055s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "1e6da450debb2f3092d39a6d55d7e477fcf1763b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'migration_context' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<9768f14b-9e34-421e-be7c-e541442814e4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Start _get_guest_xml network_info=[{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "vif_mac": "fa:16:3e:83:8a:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0cd05528-244d-421a-865f-655e2c47e44b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'c1b55f71-0808-4c96-a23a-c652e39e8a8a', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqvIyoft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9768f14b-9e34-421e-be7c-e541442814e4', 'attached_at': '', 'detached_at': '', 'volume_id': '42207515-31c1-47d2-8265-2c940db06482', 'serial': '42207515-31c1-47d2-8265-2c940db06482'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'resources' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<9768f14b-9e34-421e-be7c-e541442814e4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'numa_topology' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<9768f14b-9e34-421e-be7c-e541442814e4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:39 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:52:39 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<9768f14b-9e34-421e-be7c-e541442814e4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqvIyoft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:52:39 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:52:39 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:52:39 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully created port: e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[381bcdad-efea-4a59-b658-4305fc8531e7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JqvIyoft\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 10:52:39 user nova-compute[75020]: node.name = iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:52:39 user nova-compute[75020]: node.tpgt = -1
Nov 30 10:52:39 user nova-compute[75020]: node.startup = automatic
Nov 30 10:52:39 user nova-compute[75020]: node.leading_login = No
Nov 30 10:52:39 user nova-compute[75020]: iface.iscsi_ifacename = default
Nov 30 10:52:39 user nova-compute[75020]: iface.net_ifacename = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.ipaddress = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.prefix_len = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.hwaddress = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.transport_name = tcp
Nov 30 10:52:39 user nova-compute[75020]: iface.initiatorname = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.state = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.vlan_id = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.vlan_priority = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.vlan_state = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.iface_num = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.mtu = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.port = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.bootproto = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.subnet_mask = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.gateway = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.dhcp_alt_client_id = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.dhcp_dns = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.dhcp_learn_iqn = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.dhcp_vendor_id_state = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.dhcp_vendor_id = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.dhcp_slp_da = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.fragmentation = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.gratuitous_arp = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.incoming_forwarding = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.tos_state = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.tos = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.ttl = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.delayed_ack = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.tcp_nagle = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.tcp_wsf_state = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.tcp_wsf = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.tcp_timer_scale = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.tcp_timestamp = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.redirect = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.def_task_mgmt_timeout = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.header_digest = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.data_digest = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.immediate_data = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.initial_r2t = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.data_seq_inorder = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.data_pdu_inorder = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.erl = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.max_receive_data_len = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.first_burst_len = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.max_outstanding_r2t = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.max_burst_len = 0
Nov 30 10:52:39 user nova-compute[75020]: iface.chap_auth = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.bidi_chap = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.strict_login_compliance = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.discovery_auth = <empty>
Nov 30 10:52:39 user nova-compute[75020]: iface.discovery_logout = <empty>
Nov 30 10:52:39 user nova-compute[75020]: node.discovery_address = <empty>
Nov 30 10:52:39 user nova-compute[75020]: node.discovery_port = 0
Nov 30 10:52:39 user nova-compute[75020]: node.discovery_type = static
Nov 30 10:52:39 user nova-compute[75020]: node.session.initial_cmdsn = 0
Nov 30 10:52:39 user nova-compute[75020]: node.session.initial_login_retry_max = 8
Nov 30 10:52:39 user nova-compute[75020]: node.session.xmit_thread_priority = -20
Nov 30 10:52:39 user nova-compute[75020]: node.session.cmds_max = 128
Nov 30 10:52:39 user nova-compute[75020]: node.session.queue_depth = 32
Nov 30 10:52:39 user nova-compute[75020]: node.session.nr_sessions = 1
Nov 30 10:52:39 user nova-compute[75020]: node.session.auth.authmethod = CHAP
Nov 30 10:52:39 user nova-compute[75020]: node.session.auth.username = JqvIyoft
Nov 30 10:52:39 user nova-compute[75020]: node.session.auth.password = ***
Nov 30 10:52:39 user nova-compute[75020]: node.session.auth.username_in = <empty>
Nov 30 10:52:39 user nova-compute[75020]: node.session.auth.password_in = <empty>
Nov 30 10:52:39 user nova-compute[75020]: node.session.auth.chap_algs = MD5
Nov 30 10:52:39 user nova-compute[75020]: node.session.timeo.replacement_timeout = 120
Nov 30 10:52:39 user nova-compute[75020]: node.session.err_timeo.abort_timeout = 15
Nov 30 10:52:39 user nova-compute[75020]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 10:52:39 user nova-compute[75020]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 10:52:39 user nova-compute[75020]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.FastAbort = Yes
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.InitialR2T = No
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.ImmediateData = Yes
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.MaxConnections = 1
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 10:52:39 user nova-compute[75020]: node.session.iscsi.ERL = 0
Nov 30 10:52:39 user nova-compute[75020]: node.session.scan = manual
Nov 30 10:52:39 user nova-compute[75020]: node.session.reopen_max = 0
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].address = 172.16.0.220
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].port = 3260
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].startup = manual
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].tcp.window_size = 524288
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].tcp.type_of_service = 0
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].timeo.logout_timeout = 15
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].timeo.login_timeout = 15
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].timeo.auth_timeout = 45
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].iscsi.DataDigest = None
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].iscsi.IFMarker = No
Nov 30 10:52:39 user nova-compute[75020]: node.conn[0].iscsi.OFMarker = No
Nov 30 10:52:39 user nova-compute[75020]: # END RECORD
Nov 30 10:52:39 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c315a844-0f5d-4e07-b7c9-2bacf9d38e3c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e547dd-e991-4d22-998f-2ef3ae090678]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqvIyoft {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqvIyoft" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd47f3a-8cdc-4c67-9505-a2ded901f341]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JqvIyoft'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88a2956-d6bd-4eb5-955d-d153caf2c29e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3782f106-a27c-4da9-8afb-de02ad89f797]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:52:39 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:52:39 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:52:39 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:52:39 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:52:39 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:52:39 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:52:39 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:52:39 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b118d-13c3-4fed-9cc2-92e1a0bef283]: (4, ('0 0 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqvIyoft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.339s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] <== connect_volume: return (341ms) {'type': 'block', 'scsi_wwn': '26235653339356363', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235653339356363', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-533945810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-533945810',id=13,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:51:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-po0avutn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:51:06Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=9768f14b-9e34-421e-be7c-e541442814e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "vif_mac": "fa:16:3e:83:8a:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "vif_mac": "fa:16:3e:83:8a:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:8a:24,bridge_name='br-int',has_traffic_filtering=True,id=e6d72d13-bbe8-4450-ab51-a898223e1ca2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d72d13-bb') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'pci_devices' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.objects.base [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<9768f14b-9e34-421e-be7c-e541442814e4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:52:39 user nova-compute[75020]:   <uuid>9768f14b-9e34-421e-be7c-e541442814e4</uuid>
Nov 30 10:52:39 user nova-compute[75020]:   <name>instance-0000000d</name>
Nov 30 10:52:39 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:52:39 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:52:39 user nova-compute[75020]:   <metadata>
Nov 30 10:52:39 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:52:39 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:52:39 user nova-compute[75020]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-533945810</nova:name>
Nov 30 10:52:39 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:52:39</nova:creationTime>
Nov 30 10:52:39 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:52:39 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:52:39 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:52:39 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:52:39 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:52:39 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:52:39 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:52:39 user nova-compute[75020]:       <nova:owner>
Nov 30 10:52:39 user nova-compute[75020]:         <nova:user uuid="a93ae25dec664c44ba88b0f15f6a239e">tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member</nova:user>
Nov 30 10:52:39 user nova-compute[75020]:         <nova:project uuid="e02acda28c914dcdaa8afa65411b8055">tempest-ServerBootFromVolumeStableRescueTest-548019548</nova:project>
Nov 30 10:52:39 user nova-compute[75020]:       </nova:owner>
Nov 30 10:52:39 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:52:39 user nova-compute[75020]:       <nova:ports>
Nov 30 10:52:39 user nova-compute[75020]:         <nova:port uuid="e6d72d13-bbe8-4450-ab51-a898223e1ca2">
Nov 30 10:52:39 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 10:52:39 user nova-compute[75020]:         </nova:port>
Nov 30 10:52:39 user nova-compute[75020]:       </nova:ports>
Nov 30 10:52:39 user nova-compute[75020]:     </nova:instance>
Nov 30 10:52:39 user nova-compute[75020]:   </metadata>
Nov 30 10:52:39 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:52:39 user nova-compute[75020]:     <system>
Nov 30 10:52:39 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:52:39 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:52:39 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:52:39 user nova-compute[75020]:       <entry name="serial">9768f14b-9e34-421e-be7c-e541442814e4</entry>
Nov 30 10:52:39 user nova-compute[75020]:       <entry name="uuid">9768f14b-9e34-421e-be7c-e541442814e4</entry>
Nov 30 10:52:39 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:52:39 user nova-compute[75020]:     </system>
Nov 30 10:52:39 user nova-compute[75020]:   </sysinfo>
Nov 30 10:52:39 user nova-compute[75020]:   <os>
Nov 30 10:52:39 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:52:39 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:52:39 user nova-compute[75020]:   </os>
Nov 30 10:52:39 user nova-compute[75020]:   <features>
Nov 30 10:52:39 user nova-compute[75020]:     <acpi/>
Nov 30 10:52:39 user nova-compute[75020]:     <apic/>
Nov 30 10:52:39 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:52:39 user nova-compute[75020]:   </features>
Nov 30 10:52:39 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:52:39 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:52:39 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:52:39 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:52:39 user nova-compute[75020]:   </clock>
Nov 30 10:52:39 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:52:39 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:52:39 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:52:39 user nova-compute[75020]:   </cpu>
Nov 30 10:52:39 user nova-compute[75020]:   <devices>
Nov 30 10:52:39 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:52:39 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:52:39 user nova-compute[75020]:       <source dev="/dev/sdb"/>
Nov 30 10:52:39 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:52:39 user nova-compute[75020]:       <serial>42207515-31c1-47d2-8265-2c940db06482</serial>
Nov 30 10:52:39 user nova-compute[75020]:     </disk>
Nov 30 10:52:39 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:52:39 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:52:39 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue"/>
Nov 30 10:52:39 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 10:52:39 user nova-compute[75020]:       <boot order="1"/>
Nov 30 10:52:39 user nova-compute[75020]:     </disk>
Nov 30 10:52:39 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:52:39 user nova-compute[75020]:       <mac address="fa:16:3e:83:8a:24"/>
Nov 30 10:52:39 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:52:39 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:52:39 user nova-compute[75020]:       <target dev="tape6d72d13-bb"/>
Nov 30 10:52:39 user nova-compute[75020]:     </interface>
Nov 30 10:52:39 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:52:39 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/console.log" append="off"/>
Nov 30 10:52:39 user nova-compute[75020]:     </serial>
Nov 30 10:52:39 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:52:39 user nova-compute[75020]:     <video>
Nov 30 10:52:39 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:52:39 user nova-compute[75020]:     </video>
Nov 30 10:52:39 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:52:39 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:52:39 user nova-compute[75020]:     </rng>
Nov 30 10:52:39 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:52:39 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:52:39 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:52:39 user nova-compute[75020]:     </memballoon>
Nov 30 10:52:39 user nova-compute[75020]:   </devices>
Nov 30 10:52:39 user nova-compute[75020]: </domain>
Nov 30 10:52:39 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:39 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance destroyed successfully.
Nov 30 10:52:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No VIF found with MAC fa:16:3e:83:8a:24, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:40 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully created port: be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:52:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-929149c5-a07f-407a-83da-91ab818bc01b req-da613df7-a77e-4310-81c2-0e1095beacee service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-929149c5-a07f-407a-83da-91ab818bc01b req-da613df7-a77e-4310-81c2-0e1095beacee service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-929149c5-a07f-407a-83da-91ab818bc01b req-da613df7-a77e-4310-81c2-0e1095beacee service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-929149c5-a07f-407a-83da-91ab818bc01b req-da613df7-a77e-4310-81c2-0e1095beacee service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-929149c5-a07f-407a-83da-91ab818bc01b req-da613df7-a77e-4310-81c2-0e1095beacee service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:52:42 user nova-compute[75020]: WARNING nova.compute.manager [req-929149c5-a07f-407a-83da-91ab818bc01b req-da613df7-a77e-4310-81c2-0e1095beacee service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state active and task_state rescuing.
Nov 30 10:52:42 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully created port: 3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue --force-share --output=json" returned: 0 in 0.281s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully created port: cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-60932357-03b0-4d39-823c-a30790f66dab req-eb8b79b7-5587-4796-8587-9fa93b626528 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60932357-03b0-4d39-823c-a30790f66dab req-eb8b79b7-5587-4796-8587-9fa93b626528 service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60932357-03b0-4d39-823c-a30790f66dab req-eb8b79b7-5587-4796-8587-9fa93b626528 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60932357-03b0-4d39-823c-a30790f66dab req-eb8b79b7-5587-4796-8587-9fa93b626528 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-60932357-03b0-4d39-823c-a30790f66dab req-eb8b79b7-5587-4796-8587-9fa93b626528 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:52:44 user nova-compute[75020]: WARNING nova.compute.manager [req-60932357-03b0-4d39-823c-a30790f66dab req-eb8b79b7-5587-4796-8587-9fa93b626528 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state active and task_state rescuing.
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG nova.compute.manager [None req-ac62f9f4-9fd6-4e58-b06b-f22b647c991f tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully updated port: a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-38c1c0e9-5388-49db-aca2-80c21e14cc2c req-ecd0de5d-6951-4ecd-a682-39e74437d41c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-changed-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-38c1c0e9-5388-49db-aca2-80c21e14cc2c req-ecd0de5d-6951-4ecd-a682-39e74437d41c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing instance network info cache due to event network-changed-a1d31941-4156-494a-8d29-76ca8e68d55c. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38c1c0e9-5388-49db-aca2-80c21e14cc2c req-ecd0de5d-6951-4ecd-a682-39e74437d41c service nova] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38c1c0e9-5388-49db-aca2-80c21e14cc2c req-ecd0de5d-6951-4ecd-a682-39e74437d41c service nova] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:44 user nova-compute[75020]: DEBUG nova.network.neutron [req-38c1c0e9-5388-49db-aca2-80c21e14cc2c req-ecd0de5d-6951-4ecd-a682-39e74437d41c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing network info cache for port a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-38c1c0e9-5388-49db-aca2-80c21e14cc2c req-ecd0de5d-6951-4ecd-a682-39e74437d41c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-38c1c0e9-5388-49db-aca2-80c21e14cc2c req-ecd0de5d-6951-4ecd-a682-39e74437d41c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38c1c0e9-5388-49db-aca2-80c21e14cc2c req-ecd0de5d-6951-4ecd-a682-39e74437d41c service nova] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully updated port: ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully updated port: 592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:52:46 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:52:46 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:52:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7326MB free_disk=25.332275390625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:52:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-changed-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing instance network info cache due to event network-changed-ce75623d-157b-47ea-ab64-bc60eae638fd. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing network info cache for port ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 88815763-252f-4506-aa0c-5524e8b96e08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77a73463-ea12-43c3-83a4-803f4a535010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a4614f08-1c9b-4c2c-b541-3cae09a4d61c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a709433f-c094-4726-8498-c508e14f9d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance fae5310f-5516-4349-ad31-4df9453171a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance c60c81b0-7039-4885-87c1-dbb3e6c744a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-changed-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing instance network info cache due to event network-changed-592897fa-fa05-4a9a-bbdf-79463cfe1fef. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing network info cache for port 592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully updated port: e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG nova.network.neutron [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG nova.network.neutron [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc640c6c-8ba1-494a-8002-ff0ea38cbcaf req-4ff7a883-2d3e-4e44-ac1b-e17e0937a535 service nova] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:48 user nova-compute[75020]: INFO nova.virt.block_device [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Booting with volume 6cc6b810-305d-4e3f-936e-3f292a3bac92 at /dev/vdb
Nov 30 10:52:48 user nova-compute[75020]: DEBUG os_brick.utils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b702a583-b771-4a52-be61-57c156f183cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f967df-3e67-4279-9749-4887287fce46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5240ce14-bb3e-4dbd-9a11-2a4a9b84aa47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d2cb54-7d8d-48e0-8c12-9f6863eae116]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully updated port: be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:52:48 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:52:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c416fc-24d0-47df-a6e1-032f06d542f1]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG os_brick.utils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating existing volume attachment record: eae672c9-51cf-4291-a37c-37640f2c2f98 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-changed-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing instance network info cache due to event network-changed-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing network info cache for port e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-changed-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing instance network info cache due to event network-changed-be6010c8-ff87-41a5-90e1-bc6841d37eca. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing network info cache for port be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updating instance_info_cache with network_info: [{"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-77a73463-ea12-43c3-83a4-803f4a535010" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:52:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:52:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37a70d4c-3c9b-422a-891e-e329c4e418c3 req-1050254f-9e26-4212-a8b1-65c393826c38 service nova] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully updated port: 3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-53d8686d-5d5b-4231-afc2-99c12d556cb3 req-ec0a4729-f6ad-451b-b529-09159725eb3b service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-changed-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-53d8686d-5d5b-4231-afc2-99c12d556cb3 req-ec0a4729-f6ad-451b-b529-09159725eb3b service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing instance network info cache due to event network-changed-3751513a-9c1a-4b65-b5a2-53c8021b37bb. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53d8686d-5d5b-4231-afc2-99c12d556cb3 req-ec0a4729-f6ad-451b-b529-09159725eb3b service nova] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53d8686d-5d5b-4231-afc2-99c12d556cb3 req-ec0a4729-f6ad-451b-b529-09159725eb3b service nova] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG nova.network.neutron [req-53d8686d-5d5b-4231-afc2-99c12d556cb3 req-ec0a4729-f6ad-451b-b529-09159725eb3b service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing network info cache for port 3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG nova.network.neutron [req-53d8686d-5d5b-4231-afc2-99c12d556cb3 req-ec0a4729-f6ad-451b-b529-09159725eb3b service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG nova.network.neutron [req-53d8686d-5d5b-4231-afc2-99c12d556cb3 req-ec0a4729-f6ad-451b-b529-09159725eb3b service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Successfully updated port: cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-53d8686d-5d5b-4231-afc2-99c12d556cb3 req-ec0a4729-f6ad-451b-b529-09159725eb3b service nova] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:52:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:52:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:52:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-4ac86561-4499-4893-bf96-ca9785531b12 req-3810c2e4-54fd-4d53-ac3e-1c719df74b90 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-changed-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:52:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-4ac86561-4499-4893-bf96-ca9785531b12 req-3810c2e4-54fd-4d53-ac3e-1c719df74b90 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing instance network info cache due to event network-changed-cd6730ce-79e3-4a22-a797-ab4a5a91f519. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:52:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4ac86561-4499-4893-bf96-ca9785531b12 req-3810c2e4-54fd-4d53-ac3e-1c719df74b90 service nova] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:52:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [{"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance network_info: |[{"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:52:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4ac86561-4499-4893-bf96-ca9785531b12 req-3810c2e4-54fd-4d53-ac3e-1c719df74b90 service nova] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:52:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-4ac86561-4499-4893-bf96-ca9785531b12 req-3810c2e4-54fd-4d53-ac3e-1c719df74b90 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing network info cache for port cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:52:55 user nova-compute[75020]: DEBUG nova.network.neutron [req-4ac86561-4499-4893-bf96-ca9785531b12 req-3810c2e4-54fd-4d53-ac3e-1c719df74b90 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updated VIF entry in instance network info cache for port cd6730ce-79e3-4a22-a797-ab4a5a91f519. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:52:55 user nova-compute[75020]: DEBUG nova.network.neutron [req-4ac86561-4499-4893-bf96-ca9785531b12 req-3810c2e4-54fd-4d53-ac3e-1c719df74b90 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [{"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:52:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4ac86561-4499-4893-bf96-ca9785531b12 req-3810c2e4-54fd-4d53-ac3e-1c719df74b90 service nova] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:56 user nova-compute[75020]: INFO nova.compute.manager [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attaching volume 335f6074-9a85-4ea9-90c0-595df0d4fa0a to /dev/vdb
Nov 30 10:52:56 user nova-compute[75020]: DEBUG os_brick.utils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[060d35eb-30e9-49c4-b5db-ded4b52ad385]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[163ee491-2beb-43d0-addf-2e89718f37f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5948314d-a470-40c8-b6f1-674fe614e49f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[35844afe-c974-458b-91f2-46dac86d8535]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:52:56 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:52:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd3d493-656a-4664-ad7c-e0f8804d0898]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG os_brick.utils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:52:56 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating existing volume attachment record: 97c5f8a8-896b-4b9b-bf4f-85daae6b3ff9 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:52:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:52:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:52:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:52:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:52:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:52:59 user nova-compute[75020]: INFO nova.compute.claims [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Claim successful on node user
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:00 user nova-compute[75020]: INFO nova.compute.manager [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Terminating instance
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: INFO nova.virt.block_device [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Booting with volume aa04b94b-b46f-4e90-93bf-8e56e775b031 at /dev/vdc
Nov 30 10:53:00 user nova-compute[75020]: DEBUG os_brick.utils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c75e70d-c4db-4313-8522-0f7f00af1223]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d83bb4e-7379-43d8-a0f8-8381dd0e107b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85b850e-d98c-49a1-9f9e-5c10ec5705ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[976f3740-0ec6-4e77-abe7-e3ed5e72d755]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:53:00 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff20814-2448-4e40-ac8e-7f482871cafa]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG os_brick.utils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating existing volume attachment record: c90de4e6-0cba-407f-967c-9d2d4c858160 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-d4206e32-ef64-4b05-8a61-cc3754a92b92 req-42961955-e1ae-4f40-aa7f-a8fd284cf8f7 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received event network-vif-unplugged-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d4206e32-ef64-4b05-8a61-cc3754a92b92 req-42961955-e1ae-4f40-aa7f-a8fd284cf8f7 service nova] Acquiring lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d4206e32-ef64-4b05-8a61-cc3754a92b92 req-42961955-e1ae-4f40-aa7f-a8fd284cf8f7 service nova] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d4206e32-ef64-4b05-8a61-cc3754a92b92 req-42961955-e1ae-4f40-aa7f-a8fd284cf8f7 service nova] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-d4206e32-ef64-4b05-8a61-cc3754a92b92 req-42961955-e1ae-4f40-aa7f-a8fd284cf8f7 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] No waiting events found dispatching network-vif-unplugged-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-d4206e32-ef64-4b05-8a61-cc3754a92b92 req-42961955-e1ae-4f40-aa7f-a8fd284cf8f7 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received event network-vif-unplugged-80123461-3b78-4a9a-907b-8cf4b65af84c for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Instance destroyed successfully.
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lazy-loading 'resources' on Instance uuid a4614f08-1c9b-4c2c-b541-3cae09a4d61c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1654791619',display_name='tempest-VolumesAdminNegativeTest-server-1654791619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1654791619',id=14,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:51:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='348ee1a2d9e34ce8ad69a57323cbfb45',ramdisk_id='',reservation_id='r-hzuctm9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1613879927',owner_user_name='tempest-VolumesAdminNegativeTest-1613879927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:51:10Z,user_data=None,user_id='d0bf43699eca49558d5605f7912dc32a',uuid=a4614f08-1c9b-4c2c-b541-3cae09a4d61c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converting VIF {"id": "80123461-3b78-4a9a-907b-8cf4b65af84c", "address": "fa:16:3e:a2:71:db", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80123461-3b", "ovs_interfaceid": "80123461-3b78-4a9a-907b-8cf4b65af84c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:71:db,bridge_name='br-int',has_traffic_filtering=True,id=80123461-3b78-4a9a-907b-8cf4b65af84c,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80123461-3b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG os_vif [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:71:db,bridge_name='br-int',has_traffic_filtering=True,id=80123461-3b78-4a9a-907b-8cf4b65af84c,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80123461-3b') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80123461-3b, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=122f797c-ba40-4710-8cd7-984bd56d0bbd) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:00 user nova-compute[75020]: INFO os_vif [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:71:db,bridge_name='br-int',has_traffic_filtering=True,id=80123461-3b78-4a9a-907b-8cf4b65af84c,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80123461-3b')
Nov 30 10:53:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Deleting instance files /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c_del
Nov 30 10:53:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Deletion of /opt/stack/data/nova/instances/a4614f08-1c9b-4c2c-b541-3cae09a4d61c_del complete
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.policy [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e5b64476e654197817bd4c65a9ff9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be013073c84dd2bb58b842e6257b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:53:00 user nova-compute[75020]: INFO nova.compute.manager [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:53:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Creating image(s)
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "/opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "/opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "/opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.200s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.202s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk 1073741824" returned: 0 in 0.070s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:53:01 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Took 0.96 seconds to deallocate network for instance.
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-b722a110-e18f-4a02-a4f6-401bf9e39efd req-5290b507-7e59-4c9b-abe2-23cc663894df service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received event network-vif-deleted-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:01 user nova-compute[75020]: INFO nova.compute.manager [req-b722a110-e18f-4a02-a4f6-401bf9e39efd req-5290b507-7e59-4c9b-abe2-23cc663894df service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Neutron deleted interface 80123461-3b78-4a9a-907b-8cf4b65af84c; detaching it from the instance and deleting it from the info cache
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.network.neutron [req-b722a110-e18f-4a02-a4f6-401bf9e39efd req-5290b507-7e59-4c9b-abe2-23cc663894df service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Cannot resize image /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Ensure instance console log exists: /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-b722a110-e18f-4a02-a4f6-401bf9e39efd req-5290b507-7e59-4c9b-abe2-23cc663894df service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Detach interface failed, port_id=80123461-3b78-4a9a-907b-8cf4b65af84c, reason: Instance a4614f08-1c9b-4c2c-b541-3cae09a4d61c could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:01 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Successfully created port: d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:02 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Deleted allocations for instance a4614f08-1c9b-4c2c-b541-3cae09a4d61c
Nov 30 10:53:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a582de39-4a75-4029-8e70-eb259e4942fa tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.483s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-dc1dc404-edc6-47e7-ac22-bbacc190e08f req-30853197-7cbb-4de0-aae8-d07a7438a6d6 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received event network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc1dc404-edc6-47e7-ac22-bbacc190e08f req-30853197-7cbb-4de0-aae8-d07a7438a6d6 service nova] Acquiring lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc1dc404-edc6-47e7-ac22-bbacc190e08f req-30853197-7cbb-4de0-aae8-d07a7438a6d6 service nova] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc1dc404-edc6-47e7-ac22-bbacc190e08f req-30853197-7cbb-4de0-aae8-d07a7438a6d6 service nova] Lock "a4614f08-1c9b-4c2c-b541-3cae09a4d61c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-dc1dc404-edc6-47e7-ac22-bbacc190e08f req-30853197-7cbb-4de0-aae8-d07a7438a6d6 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] No waiting events found dispatching network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:02 user nova-compute[75020]: WARNING nova.compute.manager [req-dc1dc404-edc6-47e7-ac22-bbacc190e08f req-30853197-7cbb-4de0-aae8-d07a7438a6d6 service nova] [instance: a4614f08-1c9b-4c2c-b541-3cae09a4d61c] Received unexpected event network-vif-plugged-80123461-3b78-4a9a-907b-8cf4b65af84c for instance with vm_state deleted and task_state None.
Nov 30 10:53:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Successfully updated port: d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "refresh_cache-699e178d-3c20-4bae-ae9e-ba337ab6f5d1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquired lock "refresh_cache-699e178d-3c20-4bae-ae9e-ba337ab6f5d1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:53:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Updating instance_info_cache with network_info: [{"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Releasing lock "refresh_cache-699e178d-3c20-4bae-ae9e-ba337ab6f5d1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Instance network_info: |[{"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Start _get_guest_xml network_info=[{"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:53:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:53:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1221444370',display_name='tempest-ServersNegativeTestJSON-server-1221444370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1221444370',id=19,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07be013073c84dd2bb58b842e6257b57',ramdisk_id='',reservation_id='r-h95yhphj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-263556413',owner_user_name='tempest-ServersNegativeTestJSON-263556413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:53:01Z,user_data=None,user_id='0e5b64476e654197817bd4c65a9ff9c3',uuid=699e178d-3c20-4bae-ae9e-ba337ab6f5d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converting VIF {"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=d99de088-f342-4b91-93b6-4a642441f274,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99de088-f3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lazy-loading 'pci_devices' on Instance uuid 699e178d-3c20-4bae-ae9e-ba337ab6f5d1 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:53:03 user nova-compute[75020]:   <uuid>699e178d-3c20-4bae-ae9e-ba337ab6f5d1</uuid>
Nov 30 10:53:03 user nova-compute[75020]:   <name>instance-00000013</name>
Nov 30 10:53:03 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:53:03 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:53:03 user nova-compute[75020]:   <metadata>
Nov 30 10:53:03 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:53:03 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:53:03 user nova-compute[75020]:       <nova:name>tempest-ServersNegativeTestJSON-server-1221444370</nova:name>
Nov 30 10:53:03 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:53:03</nova:creationTime>
Nov 30 10:53:03 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:53:03 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:53:03 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:53:03 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:53:03 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:53:03 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:53:03 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:53:03 user nova-compute[75020]:       <nova:owner>
Nov 30 10:53:03 user nova-compute[75020]:         <nova:user uuid="0e5b64476e654197817bd4c65a9ff9c3">tempest-ServersNegativeTestJSON-263556413-project-member</nova:user>
Nov 30 10:53:03 user nova-compute[75020]:         <nova:project uuid="07be013073c84dd2bb58b842e6257b57">tempest-ServersNegativeTestJSON-263556413</nova:project>
Nov 30 10:53:03 user nova-compute[75020]:       </nova:owner>
Nov 30 10:53:03 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:53:03 user nova-compute[75020]:       <nova:ports>
Nov 30 10:53:03 user nova-compute[75020]:         <nova:port uuid="d99de088-f342-4b91-93b6-4a642441f274">
Nov 30 10:53:03 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 10:53:03 user nova-compute[75020]:         </nova:port>
Nov 30 10:53:03 user nova-compute[75020]:       </nova:ports>
Nov 30 10:53:03 user nova-compute[75020]:     </nova:instance>
Nov 30 10:53:03 user nova-compute[75020]:   </metadata>
Nov 30 10:53:03 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:53:03 user nova-compute[75020]:     <system>
Nov 30 10:53:03 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:53:03 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:53:03 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:53:03 user nova-compute[75020]:       <entry name="serial">699e178d-3c20-4bae-ae9e-ba337ab6f5d1</entry>
Nov 30 10:53:03 user nova-compute[75020]:       <entry name="uuid">699e178d-3c20-4bae-ae9e-ba337ab6f5d1</entry>
Nov 30 10:53:03 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:53:03 user nova-compute[75020]:     </system>
Nov 30 10:53:03 user nova-compute[75020]:   </sysinfo>
Nov 30 10:53:03 user nova-compute[75020]:   <os>
Nov 30 10:53:03 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:53:03 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:53:03 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:53:03 user nova-compute[75020]:   </os>
Nov 30 10:53:03 user nova-compute[75020]:   <features>
Nov 30 10:53:03 user nova-compute[75020]:     <acpi/>
Nov 30 10:53:03 user nova-compute[75020]:     <apic/>
Nov 30 10:53:03 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:53:03 user nova-compute[75020]:   </features>
Nov 30 10:53:03 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:53:03 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:53:03 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:53:03 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:53:03 user nova-compute[75020]:   </clock>
Nov 30 10:53:03 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:53:03 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:53:03 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:53:03 user nova-compute[75020]:   </cpu>
Nov 30 10:53:03 user nova-compute[75020]:   <devices>
Nov 30 10:53:03 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:53:03 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:53:03 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk"/>
Nov 30 10:53:03 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:53:03 user nova-compute[75020]:     </disk>
Nov 30 10:53:03 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:53:03 user nova-compute[75020]:       <mac address="fa:16:3e:f9:6c:93"/>
Nov 30 10:53:03 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:03 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:53:03 user nova-compute[75020]:       <target dev="tapd99de088-f3"/>
Nov 30 10:53:03 user nova-compute[75020]:     </interface>
Nov 30 10:53:03 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:53:03 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/console.log" append="off"/>
Nov 30 10:53:03 user nova-compute[75020]:     </serial>
Nov 30 10:53:03 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:53:03 user nova-compute[75020]:     <video>
Nov 30 10:53:03 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:03 user nova-compute[75020]:     </video>
Nov 30 10:53:03 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:53:03 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:53:03 user nova-compute[75020]:     </rng>
Nov 30 10:53:03 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:53:03 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:53:03 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:53:03 user nova-compute[75020]:     </memballoon>
Nov 30 10:53:03 user nova-compute[75020]:   </devices>
Nov 30 10:53:03 user nova-compute[75020]: </domain>
Nov 30 10:53:03 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1221444370',display_name='tempest-ServersNegativeTestJSON-server-1221444370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1221444370',id=19,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07be013073c84dd2bb58b842e6257b57',ramdisk_id='',reservation_id='r-h95yhphj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-263556413',owner_user_name='tempest-ServersNegativeTestJSON-263556413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:53:01Z,user_data=None,user_id='0e5b64476e654197817bd4c65a9ff9c3',uuid=699e178d-3c20-4bae-ae9e-ba337ab6f5d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converting VIF {"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=d99de088-f342-4b91-93b6-4a642441f274,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99de088-f3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG os_vif [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=d99de088-f342-4b91-93b6-4a642441f274,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99de088-f3') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21f7dd8e-9556-5774-8ba6-e3297f4633f8', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd99de088-f3, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd99de088-f3, col_values=(('qos', UUID('05bdb317-a969-42c1-9151-cd4c7496d7b5')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd99de088-f3, col_values=(('external_ids', {'iface-id': 'd99de088-f342-4b91-93b6-4a642441f274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:6c:93', 'vm-uuid': '699e178d-3c20-4bae-ae9e-ba337ab6f5d1'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:03 user nova-compute[75020]: INFO os_vif [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=d99de088-f342-4b91-93b6-4a642441f274,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99de088-f3')
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] No VIF found with MAC fa:16:3e:f9:6c:93, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-e50caa85-8aab-46bd-9a3b-96b8ca1c5a45 req-d16311ef-e7e4-40ec-bc36-949ef5e1f8e7 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received event network-changed-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-e50caa85-8aab-46bd-9a3b-96b8ca1c5a45 req-d16311ef-e7e4-40ec-bc36-949ef5e1f8e7 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Refreshing instance network info cache due to event network-changed-d99de088-f342-4b91-93b6-4a642441f274. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e50caa85-8aab-46bd-9a3b-96b8ca1c5a45 req-d16311ef-e7e4-40ec-bc36-949ef5e1f8e7 service nova] Acquiring lock "refresh_cache-699e178d-3c20-4bae-ae9e-ba337ab6f5d1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e50caa85-8aab-46bd-9a3b-96b8ca1c5a45 req-d16311ef-e7e4-40ec-bc36-949ef5e1f8e7 service nova] Acquired lock "refresh_cache-699e178d-3c20-4bae-ae9e-ba337ab6f5d1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:53:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-e50caa85-8aab-46bd-9a3b-96b8ca1c5a45 req-d16311ef-e7e4-40ec-bc36-949ef5e1f8e7 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Refreshing network info cache for port d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:53:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-3e280e76-de5d-4a8f-972b-34a56d4b651b req-006dd340-9bb8-4612-a6da-2c6cc214bde0 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received event network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3e280e76-de5d-4a8f-972b-34a56d4b651b req-006dd340-9bb8-4612-a6da-2c6cc214bde0 service nova] Acquiring lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3e280e76-de5d-4a8f-972b-34a56d4b651b req-006dd340-9bb8-4612-a6da-2c6cc214bde0 service nova] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3e280e76-de5d-4a8f-972b-34a56d4b651b req-006dd340-9bb8-4612-a6da-2c6cc214bde0 service nova] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-3e280e76-de5d-4a8f-972b-34a56d4b651b req-006dd340-9bb8-4612-a6da-2c6cc214bde0 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] No waiting events found dispatching network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:04 user nova-compute[75020]: WARNING nova.compute.manager [req-3e280e76-de5d-4a8f-972b-34a56d4b651b req-006dd340-9bb8-4612-a6da-2c6cc214bde0 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received unexpected event network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 for instance with vm_state building and task_state spawning.
Nov 30 10:53:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-e50caa85-8aab-46bd-9a3b-96b8ca1c5a45 req-d16311ef-e7e4-40ec-bc36-949ef5e1f8e7 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Updated VIF entry in instance network info cache for port d99de088-f342-4b91-93b6-4a642441f274. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:53:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-e50caa85-8aab-46bd-9a3b-96b8ca1c5a45 req-d16311ef-e7e4-40ec-bc36-949ef5e1f8e7 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Updating instance_info_cache with network_info: [{"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:53:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e50caa85-8aab-46bd-9a3b-96b8ca1c5a45 req-d16311ef-e7e4-40ec-bc36-949ef5e1f8e7 service nova] Releasing lock "refresh_cache-699e178d-3c20-4bae-ae9e-ba337ab6f5d1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-0d26f292-df53-42f3-bcc1-da67c47e3c3d req-f860c914-f1f5-4cac-b2b0-7fddf219f79e service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received event network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0d26f292-df53-42f3-bcc1-da67c47e3c3d req-f860c914-f1f5-4cac-b2b0-7fddf219f79e service nova] Acquiring lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0d26f292-df53-42f3-bcc1-da67c47e3c3d req-f860c914-f1f5-4cac-b2b0-7fddf219f79e service nova] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0d26f292-df53-42f3-bcc1-da67c47e3c3d req-f860c914-f1f5-4cac-b2b0-7fddf219f79e service nova] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-0d26f292-df53-42f3-bcc1-da67c47e3c3d req-f860c914-f1f5-4cac-b2b0-7fddf219f79e service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] No waiting events found dispatching network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:06 user nova-compute[75020]: WARNING nova.compute.manager [req-0d26f292-df53-42f3-bcc1-da67c47e3c3d req-f860c914-f1f5-4cac-b2b0-7fddf219f79e service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received unexpected event network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 for instance with vm_state building and task_state spawning.
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:53:06 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Instance spawned successfully.
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:07 user nova-compute[75020]: INFO nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 30 10:53:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:53:07 user nova-compute[75020]: INFO nova.compute.manager [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Took 7.52 seconds to build instance.
Nov 30 10:53:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15ac768c-d9d5-46c5-8697-f654b6bdf03f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.664s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:53:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Creating image(s)
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Ensure instance console log exists: /opt/stack/data/nova/instances/c60c81b0-7039-4885-87c1-dbb3e6c744a4/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Start _get_guest_xml network_info=[{"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '8c50def1-6ff0-4c14-8a11-eeb2bf244eb6', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkyMNdWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4', 'attached_at': '', 'detached_at': '', 'volume_id': '8b7b1dc3-77db-4e41-b4b2-8b0b60703870', 'serial': '8b7b1dc3-77db-4e41-b4b2-8b0b60703870'}, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'eae672c9-51cf-4291-a37c-37640f2c2f98', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWropJYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4', 'attached_at': '', 'detached_at': '', 'volume_id': '6cc6b810-305d-4e3f-936e-3f292a3bac92', 'serial': '6cc6b810-305d-4e3f-936e-3f292a3bac92'}, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'c90de4e6-0cba-407f-967c-9d2d4c858160', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlhvKsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa04b94b-b46f-4e90-93bf-8e56e775b031', 'serial': 'aa04b94b-b46f-4e90-93bf-8e56e775b031'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:53:12 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:53:12 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkyMNdWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:12 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:12 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:12 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6f6e1-7d3d-4afb-afec-3147aaba2bff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:53:12 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7de91c9-e042-4483-ab70-eaa4f7cf3004]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870] added
Nov 30 10:53:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fb33b8-01a8-414e-ac73-fba7eaa15628]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[571d0f69-85c9-429d-a49f-77135e903836]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HkyMNdWR {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HkyMNdWR" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1021588-ebb1-4ad6-9772-b49b7a7bba3d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HkyMNdWR'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[313142d8-30ca-486e-873f-94fddb913d65]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[750d4d4e-8533-4e9c-adc4-52edb75dc1f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3552013-a638-48c8-be49-aba7104ece1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870, portal: 172.16.0.220,3260]
Nov 30 10:53:12 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fdb7ab-1eab-4f6c-b83b-05827411dac1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ca7bc2-30b8-43a8-beb6-d209c884a204]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:12 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[11156ae8-90e6-4ab4-8773-937cdc1028f4]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:53:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkyMNdWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26138623238313630', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138623238313630', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWropJYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:13 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:13 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:13 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[610d29d3-093f-4109-9ec4-cbd51254ff04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:53:13 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a3cbc-ea74-4e1e-9b55-4275bc06490c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92] added
Nov 30 10:53:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c786add6-f330-4429-91a0-051b74489e77]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4667c16-7099-40d9-8bf7-0707641cc659]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dWropJYt {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dWropJYt" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[41202c41-2577-43da-acdc-94bdb92ef7e9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dWropJYt'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d37a019-7679-4b98-9e33-cbfa346bb4be]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee08fa9-6395-4999-adab-98b9a7a00c28]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5469c33-7367-4d46-a96b-b954a4528f0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92, portal: 172.16.0.220,3260]
Nov 30 10:53:13 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b25766-c57a-4877-be54-ddcbbe410341]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[77249fa0-0bc9-4387-9058-a464113747e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:53:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:14 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8211c282-5c0a-4778-bfcb-6b78e0eae7e3]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:14 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:53:14 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWropJYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26633306363653564', 'path': '/dev/sdf'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633306363653564', 'path': '/dev/sdf'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlhvKsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:15 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:15 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:15 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ba88dd-9092-470b-8241-d80bf8aa33bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:53:15 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c521f2d5-71f7-4f5d-bdbf-a4e39bec3306]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031] added
Nov 30 10:53:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013723c-6f7b-47e1-a3d8-5f85fcfbd6ea]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f6a17-9202-4c7d-8671-f311843fddd2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlhvKsSa {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlhvKsSa" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2bf290-7411-4747-aa97-853cea33cd59]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tlhvKsSa'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1a004e-c19d-4deb-94c6-6134c1d9d6ba]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67351e3-df17-422a-a318-6f5150a8b37b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3134eb-4d66-472d-b291-56c05d85fb98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031, portal: 172.16.0.220,3260]
Nov 30 10:53:15 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc48f4-121b-4ec5-a04a-7d1498abf82b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[11149560-31cb-47cb-8daf-8061c41c88f5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9aa377-d835-4417-b0c0-a539ede580b6]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:53:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlhvKsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23631366433643934', 'path': '/dev/sdg'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631366433643934', 'path': '/dev/sdg'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:a8:50,bridge_name='br-int',has_traffic_filtering=True,id=a1d31941-4156-494a-8d29-76ca8e68d55c,network=Network(6dcd95a6-8dc0-482e-9d98-8a4dde66edd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d31941-41') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:48,bridge_name='br-int',has_traffic_filtering=True,id=ce75623d-157b-47ea-ab64-bc60eae638fd,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce75623d-15') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:35:7a,bridge_name='br-int',has_traffic_filtering=True,id=592897fa-fa05-4a9a-bbdf-79463cfe1fef,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap592897fa-fa') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:4b,bridge_name='br-int',has_traffic_filtering=True,id=e9e87fc6-6f34-4260-aa9b-4ba4fa624d83,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e87fc6-6f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=be6010c8-ff87-41a5-90e1-bc6841d37eca,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6010c8-ff') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:10:72,bridge_name='br-int',has_traffic_filtering=True,id=3751513a-9c1a-4b65-b5a2-53c8021b37bb,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3751513a-9c') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0f:b7,bridge_name='br-int',has_traffic_filtering=True,id=cd6730ce-79e3-4a22-a797-ab4a5a91f519,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6730ce-79') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lazy-loading 'pci_devices' on Instance uuid c60c81b0-7039-4885-87c1-dbb3e6c744a4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:53:16 user nova-compute[75020]:   <uuid>c60c81b0-7039-4885-87c1-dbb3e6c744a4</uuid>
Nov 30 10:53:16 user nova-compute[75020]:   <name>instance-00000012</name>
Nov 30 10:53:16 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:53:16 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:53:16 user nova-compute[75020]:   <metadata>
Nov 30 10:53:16 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:53:16 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:53:16 user nova-compute[75020]:       <nova:name>tempest-device-tagging-server-1162003227</nova:name>
Nov 30 10:53:16 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:53:12</nova:creationTime>
Nov 30 10:53:16 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:53:16 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:53:16 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:53:16 user nova-compute[75020]:       <nova:owner>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:user uuid="b9540302fa89436f950812bd909b60a0">tempest-TaggedBootDevicesTest-1539700782-project-member</nova:user>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:project uuid="a2bb1b67a71e4a2a93627458172d7d09">tempest-TaggedBootDevicesTest-1539700782</nova:project>
Nov 30 10:53:16 user nova-compute[75020]:       </nova:owner>
Nov 30 10:53:16 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:53:16 user nova-compute[75020]:       <nova:ports>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:port uuid="a1d31941-4156-494a-8d29-76ca8e68d55c">
Nov 30 10:53:16 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 10:53:16 user nova-compute[75020]:         </nova:port>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:port uuid="ce75623d-157b-47ea-ab64-bc60eae638fd">
Nov 30 10:53:16 user nova-compute[75020]:           <nova:ip type="fixed" address="10.1.1.26" ipVersion="4"/>
Nov 30 10:53:16 user nova-compute[75020]:         </nova:port>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:port uuid="592897fa-fa05-4a9a-bbdf-79463cfe1fef">
Nov 30 10:53:16 user nova-compute[75020]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Nov 30 10:53:16 user nova-compute[75020]:         </nova:port>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:port uuid="e9e87fc6-6f34-4260-aa9b-4ba4fa624d83">
Nov 30 10:53:16 user nova-compute[75020]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Nov 30 10:53:16 user nova-compute[75020]:         </nova:port>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:port uuid="be6010c8-ff87-41a5-90e1-bc6841d37eca">
Nov 30 10:53:16 user nova-compute[75020]:           <nova:ip type="fixed" address="10.1.1.92" ipVersion="4"/>
Nov 30 10:53:16 user nova-compute[75020]:         </nova:port>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:port uuid="3751513a-9c1a-4b65-b5a2-53c8021b37bb">
Nov 30 10:53:16 user nova-compute[75020]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 10:53:16 user nova-compute[75020]:         </nova:port>
Nov 30 10:53:16 user nova-compute[75020]:         <nova:port uuid="cd6730ce-79e3-4a22-a797-ab4a5a91f519">
Nov 30 10:53:16 user nova-compute[75020]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 10:53:16 user nova-compute[75020]:         </nova:port>
Nov 30 10:53:16 user nova-compute[75020]:       </nova:ports>
Nov 30 10:53:16 user nova-compute[75020]:     </nova:instance>
Nov 30 10:53:16 user nova-compute[75020]:   </metadata>
Nov 30 10:53:16 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:53:16 user nova-compute[75020]:     <system>
Nov 30 10:53:16 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:53:16 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:53:16 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:53:16 user nova-compute[75020]:       <entry name="serial">c60c81b0-7039-4885-87c1-dbb3e6c744a4</entry>
Nov 30 10:53:16 user nova-compute[75020]:       <entry name="uuid">c60c81b0-7039-4885-87c1-dbb3e6c744a4</entry>
Nov 30 10:53:16 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:53:16 user nova-compute[75020]:     </system>
Nov 30 10:53:16 user nova-compute[75020]:   </sysinfo>
Nov 30 10:53:16 user nova-compute[75020]:   <os>
Nov 30 10:53:16 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:53:16 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:53:16 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:53:16 user nova-compute[75020]:   </os>
Nov 30 10:53:16 user nova-compute[75020]:   <features>
Nov 30 10:53:16 user nova-compute[75020]:     <acpi/>
Nov 30 10:53:16 user nova-compute[75020]:     <apic/>
Nov 30 10:53:16 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:53:16 user nova-compute[75020]:   </features>
Nov 30 10:53:16 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:53:16 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:53:16 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:53:16 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:53:16 user nova-compute[75020]:   </clock>
Nov 30 10:53:16 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:53:16 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:53:16 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:53:16 user nova-compute[75020]:   </cpu>
Nov 30 10:53:16 user nova-compute[75020]:   <devices>
Nov 30 10:53:16 user nova-compute[75020]:     <disk type="file" device="cdrom">
Nov 30 10:53:16 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 10:53:16 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/c60c81b0-7039-4885-87c1-dbb3e6c744a4/disk.config"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="hda" bus="ide"/>
Nov 30 10:53:16 user nova-compute[75020]:     </disk>
Nov 30 10:53:16 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:53:16 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:16 user nova-compute[75020]:       <source dev="/dev/sdc"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <serial>8b7b1dc3-77db-4e41-b4b2-8b0b60703870</serial>
Nov 30 10:53:16 user nova-compute[75020]:     </disk>
Nov 30 10:53:16 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:53:16 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:16 user nova-compute[75020]:       <source dev="/dev/sdf"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <serial>6cc6b810-305d-4e3f-936e-3f292a3bac92</serial>
Nov 30 10:53:16 user nova-compute[75020]:     </disk>
Nov 30 10:53:16 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:53:16 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:16 user nova-compute[75020]:       <source dev="/dev/sdg"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="vdc" bus="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <serial>aa04b94b-b46f-4e90-93bf-8e56e775b031</serial>
Nov 30 10:53:16 user nova-compute[75020]:     </disk>
Nov 30 10:53:16 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:53:16 user nova-compute[75020]:       <mac address="fa:16:3e:dd:a8:50"/>
Nov 30 10:53:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="tapa1d31941-41"/>
Nov 30 10:53:16 user nova-compute[75020]:     </interface>
Nov 30 10:53:16 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:53:16 user nova-compute[75020]:       <mac address="fa:16:3e:64:d0:48"/>
Nov 30 10:53:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="tapce75623d-15"/>
Nov 30 10:53:16 user nova-compute[75020]:     </interface>
Nov 30 10:53:16 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:53:16 user nova-compute[75020]:       <mac address="fa:16:3e:c0:35:7a"/>
Nov 30 10:53:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="tap592897fa-fa"/>
Nov 30 10:53:16 user nova-compute[75020]:     </interface>
Nov 30 10:53:16 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:53:16 user nova-compute[75020]:       <mac address="fa:16:3e:a5:04:4b"/>
Nov 30 10:53:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="tape9e87fc6-6f"/>
Nov 30 10:53:16 user nova-compute[75020]:     </interface>
Nov 30 10:53:16 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:53:16 user nova-compute[75020]:       <mac address="fa:16:3e:0b:f7:02"/>
Nov 30 10:53:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="tapbe6010c8-ff"/>
Nov 30 10:53:16 user nova-compute[75020]:     </interface>
Nov 30 10:53:16 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:53:16 user nova-compute[75020]:       <mac address="fa:16:3e:72:10:72"/>
Nov 30 10:53:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="tap3751513a-9c"/>
Nov 30 10:53:16 user nova-compute[75020]:     </interface>
Nov 30 10:53:16 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:53:16 user nova-compute[75020]:       <mac address="fa:16:3e:1f:0f:b7"/>
Nov 30 10:53:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:53:16 user nova-compute[75020]:       <target dev="tapcd6730ce-79"/>
Nov 30 10:53:16 user nova-compute[75020]:     </interface>
Nov 30 10:53:16 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:53:16 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/c60c81b0-7039-4885-87c1-dbb3e6c744a4/console.log" append="off"/>
Nov 30 10:53:16 user nova-compute[75020]:     </serial>
Nov 30 10:53:16 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:53:16 user nova-compute[75020]:     <video>
Nov 30 10:53:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:53:16 user nova-compute[75020]:     </video>
Nov 30 10:53:16 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:53:16 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:53:16 user nova-compute[75020]:     </rng>
Nov 30 10:53:16 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:53:16 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:53:16 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:53:16 user nova-compute[75020]:     </memballoon>
Nov 30 10:53:16 user nova-compute[75020]:   </devices>
Nov 30 10:53:16 user nova-compute[75020]: </domain>
Nov 30 10:53:16 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:a8:50,bridge_name='br-int',has_traffic_filtering=True,id=a1d31941-4156-494a-8d29-76ca8e68d55c,network=Network(6dcd95a6-8dc0-482e-9d98-8a4dde66edd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d31941-41') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:a8:50,bridge_name='br-int',has_traffic_filtering=True,id=a1d31941-4156-494a-8d29-76ca8e68d55c,network=Network(6dcd95a6-8dc0-482e-9d98-8a4dde66edd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d31941-41') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4442f9f6-7aaa-5f03-8a10-9e492b35be7a', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1d31941-41, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1d31941-41, col_values=(('qos', UUID('3f40d79b-e7bd-4caf-a1f7-659dcca9cf32')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1d31941-41, col_values=(('external_ids', {'iface-id': 'a1d31941-4156-494a-8d29-76ca8e68d55c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:a8:50', 'vm-uuid': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: INFO os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:a8:50,bridge_name='br-int',has_traffic_filtering=True,id=a1d31941-4156-494a-8d29-76ca8e68d55c,network=Network(6dcd95a6-8dc0-482e-9d98-8a4dde66edd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d31941-41')
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:48,bridge_name='br-int',has_traffic_filtering=True,id=ce75623d-157b-47ea-ab64-bc60eae638fd,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce75623d-15') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:48,bridge_name='br-int',has_traffic_filtering=True,id=ce75623d-157b-47ea-ab64-bc60eae638fd,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce75623d-15') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58868333-6653-59f9-b49a-f1367f38fefa', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce75623d-15, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce75623d-15, col_values=(('qos', UUID('3e5fd72b-c666-4160-ba8d-a16eaf4ad7fc')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce75623d-15, col_values=(('external_ids', {'iface-id': 'ce75623d-157b-47ea-ab64-bc60eae638fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:d0:48', 'vm-uuid': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: INFO os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:48,bridge_name='br-int',has_traffic_filtering=True,id=ce75623d-157b-47ea-ab64-bc60eae638fd,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce75623d-15')
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:35:7a,bridge_name='br-int',has_traffic_filtering=True,id=592897fa-fa05-4a9a-bbdf-79463cfe1fef,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap592897fa-fa') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:35:7a,bridge_name='br-int',has_traffic_filtering=True,id=592897fa-fa05-4a9a-bbdf-79463cfe1fef,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap592897fa-fa') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23279230-3e60-5b37-8504-b0125c7a2c6d', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap592897fa-fa, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap592897fa-fa, col_values=(('qos', UUID('87647ede-18ed-41af-b74c-79332ee22cae')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap592897fa-fa, col_values=(('external_ids', {'iface-id': '592897fa-fa05-4a9a-bbdf-79463cfe1fef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:35:7a', 'vm-uuid': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: INFO os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:35:7a,bridge_name='br-int',has_traffic_filtering=True,id=592897fa-fa05-4a9a-bbdf-79463cfe1fef,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap592897fa-fa')
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:4b,bridge_name='br-int',has_traffic_filtering=True,id=e9e87fc6-6f34-4260-aa9b-4ba4fa624d83,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e87fc6-6f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:4b,bridge_name='br-int',has_traffic_filtering=True,id=e9e87fc6-6f34-4260-aa9b-4ba4fa624d83,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e87fc6-6f') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2571374-12c0-56ee-adba-e29e42549254', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9e87fc6-6f, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9e87fc6-6f, col_values=(('qos', UUID('fd988f1d-af55-4971-8a16-ff23570d7ab2')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9e87fc6-6f, col_values=(('external_ids', {'iface-id': 'e9e87fc6-6f34-4260-aa9b-4ba4fa624d83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:04:4b', 'vm-uuid': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: INFO os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:4b,bridge_name='br-int',has_traffic_filtering=True,id=e9e87fc6-6f34-4260-aa9b-4ba4fa624d83,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e87fc6-6f')
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=be6010c8-ff87-41a5-90e1-bc6841d37eca,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6010c8-ff') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=be6010c8-ff87-41a5-90e1-bc6841d37eca,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6010c8-ff') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '238a0289-6b51-5716-b191-86f46bc61ef2', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe6010c8-ff, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe6010c8-ff, col_values=(('qos', UUID('3117423a-ca6b-4965-9d1d-3958244cb58d')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe6010c8-ff, col_values=(('external_ids', {'iface-id': 'be6010c8-ff87-41a5-90e1-bc6841d37eca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:f7:02', 'vm-uuid': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: INFO os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=be6010c8-ff87-41a5-90e1-bc6841d37eca,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6010c8-ff')
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:10:72,bridge_name='br-int',has_traffic_filtering=True,id=3751513a-9c1a-4b65-b5a2-53c8021b37bb,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3751513a-9c') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:10:72,bridge_name='br-int',has_traffic_filtering=True,id=3751513a-9c1a-4b65-b5a2-53c8021b37bb,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3751513a-9c') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4ae13cc-fae8-5e74-a9b0-868b2420a8c3', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3751513a-9c, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3751513a-9c, col_values=(('qos', UUID('f250a1bf-73d0-4bfe-b8e3-11f5a06061e7')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3751513a-9c, col_values=(('external_ids', {'iface-id': '3751513a-9c1a-4b65-b5a2-53c8021b37bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:10:72', 'vm-uuid': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:17 user nova-compute[75020]: INFO os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:10:72,bridge_name='br-int',has_traffic_filtering=True,id=3751513a-9c1a-4b65-b5a2-53c8021b37bb,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3751513a-9c')
Nov 30 10:53:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0f:b7,bridge_name='br-int',has_traffic_filtering=True,id=cd6730ce-79e3-4a22-a797-ab4a5a91f519,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6730ce-79') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0f:b7,bridge_name='br-int',has_traffic_filtering=True,id=cd6730ce-79e3-4a22-a797-ab4a5a91f519,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6730ce-79') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c64159a0-048b-5209-85ec-f7fa17c9d72c', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd6730ce-79, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd6730ce-79, col_values=(('qos', UUID('1bb9bb0c-0e0e-427c-8027-53502b743676')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd6730ce-79, col_values=(('external_ids', {'iface-id': 'cd6730ce-79e3-4a22-a797-ab4a5a91f519', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:0f:b7', 'vm-uuid': 'c60c81b0-7039-4885-87c1-dbb3e6c744a4'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:17 user nova-compute[75020]: INFO os_vif [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0f:b7,bridge_name='br-int',has_traffic_filtering=True,id=cd6730ce-79e3-4a22-a797-ab4a5a91f519,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6730ce-79')
Nov 30 10:53:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] No BDM found with device name hda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] No VIF found with MAC fa:16:3e:dd:a8:50, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] No VIF found with MAC fa:16:3e:0b:f7:02, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:53:17 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Using config drive
Nov 30 10:53:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jimxRdyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:17 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:17 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:17 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dbb497-6bb6-4ee1-bf89-a2af991682ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:53:17 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f348fbfa-bfed-4a07-bbcd-a37e4e82fe96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a] added
Nov 30 10:53:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec2c37-f95c-4513-9ff4-4f5ee44d5e60]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[31291218-9c01-4def-8a45-02eb9d11f498]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jimxRdyt {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jimxRdyt" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f5613b-e210-41fe-ac88-9c0b357c6291]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jimxRdyt'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86c60eb-09e3-400b-b37f-fbd6517a1d09]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[32730003-ed78-4e3a-96a8-b3071ae393e2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Creating config drive at /opt/stack/data/nova/instances/c60c81b0-7039-4885-87c1-dbb3e6c744a4/disk.config
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c60c81b0-7039-4885-87c1-dbb3e6c744a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprhkbry0g {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c60c81b0-7039-4885-87c1-dbb3e6c744a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprhkbry0g" returned: 0 in 0.063s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc655277-4d6c-49a3-a06c-1d718f705999]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a, portal: 172.16.0.220,3260]
Nov 30 10:53:17 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c1954a-6eca-4d88-bdd0-093ea02b2978]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5767db-0618-4d9f-be6a-a692c9fb5f40]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)
Nov 30 10:53:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:17 user nova-compute[75020]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)
Nov 30 10:53:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d4be6d-abb1-4e4b-8ff7-e58e3005dadd]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:53:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jimxRdyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:53:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:18 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:18 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26439376563333230', 'path': '/dev/sdh'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439376563333230', 'path': '/dev/sdh'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:53:18 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:53:18 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:18 user nova-compute[75020]:   <source dev="/dev/sdh"/>
Nov 30 10:53:18 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:53:18 user nova-compute[75020]:   <serial>335f6074-9a85-4ea9-90c0-595df0d4fa0a</serial>
Nov 30 10:53:18 user nova-compute[75020]: </disk>
Nov 30 10:53:18 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No VIF found with MAC fa:16:3e:09:53:aa, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-df59e90f-5e4a-477d-863a-f0031926abc7 req-99dfb9b3-6907-4f24-8513-9d8de9675ab8 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df59e90f-5e4a-477d-863a-f0031926abc7 req-99dfb9b3-6907-4f24-8513-9d8de9675ab8 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df59e90f-5e4a-477d-863a-f0031926abc7 req-99dfb9b3-6907-4f24-8513-9d8de9675ab8 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df59e90f-5e4a-477d-863a-f0031926abc7 req-99dfb9b3-6907-4f24-8513-9d8de9675ab8 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-df59e90f-5e4a-477d-863a-f0031926abc7 req-99dfb9b3-6907-4f24-8513-9d8de9675ab8 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:19 user nova-compute[75020]: WARNING nova.compute.manager [req-df59e90f-5e4a-477d-863a-f0031926abc7 req-99dfb9b3-6907-4f24-8513-9d8de9675ab8 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c for instance with vm_state building and task_state spawning.
Nov 30 10:53:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c5108733-3c56-4e88-a4cd-e3fc79987172 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.041s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-a5b007f5-e240-470f-942f-63cef24edf3e req-5bc61e2f-df60-4a0b-a8d2-f06b92810089 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a5b007f5-e240-470f-942f-63cef24edf3e req-5bc61e2f-df60-4a0b-a8d2-f06b92810089 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a5b007f5-e240-470f-942f-63cef24edf3e req-5bc61e2f-df60-4a0b-a8d2-f06b92810089 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a5b007f5-e240-470f-942f-63cef24edf3e req-5bc61e2f-df60-4a0b-a8d2-f06b92810089 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-a5b007f5-e240-470f-942f-63cef24edf3e req-5bc61e2f-df60-4a0b-a8d2-f06b92810089 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-a5b007f5-e240-470f-942f-63cef24edf3e req-5bc61e2f-df60-4a0b-a8d2-f06b92810089 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-e9da60b7-b856-4e0c-83d7-28828ade89ad req-1a5a6c11-c9bc-4470-9828-3bebe992b108 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-95106d7a-f852-4922-accf-61ba39a93517 req-956d36f4-87ec-4b09-b224-f15df69b1bc5 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95106d7a-f852-4922-accf-61ba39a93517 req-956d36f4-87ec-4b09-b224-f15df69b1bc5 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95106d7a-f852-4922-accf-61ba39a93517 req-956d36f4-87ec-4b09-b224-f15df69b1bc5 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-95106d7a-f852-4922-accf-61ba39a93517 req-956d36f4-87ec-4b09-b224-f15df69b1bc5 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-95106d7a-f852-4922-accf-61ba39a93517 req-956d36f4-87ec-4b09-b224-f15df69b1bc5 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:21 user nova-compute[75020]: WARNING nova.compute.manager [req-95106d7a-f852-4922-accf-61ba39a93517 req-956d36f4-87ec-4b09-b224-f15df69b1bc5 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 for instance with vm_state building and task_state spawning.
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:22 user nova-compute[75020]: INFO nova.compute.manager [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Detaching volume 335f6074-9a85-4ea9-90c0-595df0d4fa0a
Nov 30 10:53:22 user nova-compute[75020]: INFO nova.virt.block_device [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attempting to driver detach volume 335f6074-9a85-4ea9-90c0-595df0d4fa0a from mountpoint /dev/vdb
Nov 30 10:53:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Attempting to detach device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:53:22 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:22 user nova-compute[75020]:   <source dev="/dev/sdh"/>
Nov 30 10:53:22 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:53:22 user nova-compute[75020]:   <serial>335f6074-9a85-4ea9-90c0-595df0d4fa0a</serial>
Nov 30 10:53:22 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:53:22 user nova-compute[75020]: </disk>
Nov 30 10:53:22 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:53:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully detached device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the persistent domain config.
Nov 30 10:53:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:53:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:53:22 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:22 user nova-compute[75020]:   <source dev="/dev/sdh"/>
Nov 30 10:53:22 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:53:22 user nova-compute[75020]:   <serial>335f6074-9a85-4ea9-90c0-595df0d4fa0a</serial>
Nov 30 10:53:22 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:53:22 user nova-compute[75020]: </disk>
Nov 30 10:53:22 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:23 user nova-compute[75020]: WARNING nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 for instance with vm_state building and task_state spawning.
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:23 user nova-compute[75020]: WARNING nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb for instance with vm_state building and task_state spawning.
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:23 user nova-compute[75020]: WARNING nova.compute.manager [req-501ccbf3-a173-4ddb-a508-0d13e8d28187 req-d7f09b21-422c-4008-beb8-535e3e2c1e03 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb for instance with vm_state building and task_state spawning.
Nov 30 10:53:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-5550d546-3cd8-4dde-8326-56a0c0708ff2 req-a8b5308d-ff77-491f-87a8-9e2180d00621 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5550d546-3cd8-4dde-8326-56a0c0708ff2 req-a8b5308d-ff77-491f-87a8-9e2180d00621 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5550d546-3cd8-4dde-8326-56a0c0708ff2 req-a8b5308d-ff77-491f-87a8-9e2180d00621 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5550d546-3cd8-4dde-8326-56a0c0708ff2 req-a8b5308d-ff77-491f-87a8-9e2180d00621 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-5550d546-3cd8-4dde-8326-56a0c0708ff2 req-a8b5308d-ff77-491f-87a8-9e2180d00621 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:23 user nova-compute[75020]: WARNING nova.compute.manager [req-5550d546-3cd8-4dde-8326-56a0c0708ff2 req-a8b5308d-ff77-491f-87a8-9e2180d00621 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 for instance with vm_state building and task_state spawning.
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:53:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance spawned successfully.
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:53:24 user nova-compute[75020]: INFO nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Took 11.85 seconds to spawn the instance on the hypervisor.
Nov 30 10:53:24 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:53:24 user nova-compute[75020]: INFO nova.compute.manager [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Took 49.21 seconds to build instance.
Nov 30 10:53:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f60d4d5a-6e93-4f47-8e74-b5b981c0efa4 tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.494s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-a43eb4dd-70e0-4b61-adcf-971bb3d1ce35 req-d12defb5-ff33-42ef-83f9-de1cc06c6a35 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-changed-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-a43eb4dd-70e0-4b61-adcf-971bb3d1ce35 req-d12defb5-ff33-42ef-83f9-de1cc06c6a35 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Refreshing instance network info cache due to event network-changed-78557a1a-289d-4be3-b859-f3f8623fd45c. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:53:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a43eb4dd-70e0-4b61-adcf-971bb3d1ce35 req-d12defb5-ff33-42ef-83f9-de1cc06c6a35 service nova] Acquiring lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:53:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a43eb4dd-70e0-4b61-adcf-971bb3d1ce35 req-d12defb5-ff33-42ef-83f9-de1cc06c6a35 service nova] Acquired lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:53:28 user nova-compute[75020]: DEBUG nova.network.neutron [req-a43eb4dd-70e0-4b61-adcf-971bb3d1ce35 req-d12defb5-ff33-42ef-83f9-de1cc06c6a35 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Refreshing network info cache for port 78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG nova.network.neutron [req-a43eb4dd-70e0-4b61-adcf-971bb3d1ce35 req-d12defb5-ff33-42ef-83f9-de1cc06c6a35 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Updated VIF entry in instance network info cache for port 78557a1a-289d-4be3-b859-f3f8623fd45c. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG nova.network.neutron [req-a43eb4dd-70e0-4b61-adcf-971bb3d1ce35 req-d12defb5-ff33-42ef-83f9-de1cc06c6a35 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Updating instance_info_cache with network_info: [{"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a43eb4dd-70e0-4b61-adcf-971bb3d1ce35 req-d12defb5-ff33-42ef-83f9-de1cc06c6a35 service nova] Releasing lock "refresh_cache-5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG nova.objects.instance [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'flavor' on Instance uuid 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:29 user nova-compute[75020]: INFO nova.compute.manager [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Attaching volume 8683b106-c46e-48dd-8c38-edc266cd94f9 to /dev/vdb
Nov 30 10:53:29 user nova-compute[75020]: DEBUG os_brick.utils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe5e609-3bab-4331-9d09-584f074d1209]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cddf3e6-fadc-4d95-ac37-bd2d143c7894]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[475ceece-107f-4149-b3b8-8994d5a5db0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deaa59a-e9a2-4423-8079-a89a739c61ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:53:29 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f79a04-ce73-4d87-8ba8-7fa33099a5a6]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG os_brick.utils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:29 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Updating existing volume attachment record: 0dde78be-942a-4f53-b598-3bf8c0680e7e {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:53:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:30 user nova-compute[75020]: INFO nova.compute.manager [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Detaching volume 6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb
Nov 30 10:53:30 user nova-compute[75020]: INFO nova.virt.block_device [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Attempting to driver detach volume 6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb from mountpoint /dev/vdc
Nov 30 10:53:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Attempting to detach device vdc from instance a709433f-c094-4726-8498-c508e14f9d54 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:53:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:53:30 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:30 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:53:30 user nova-compute[75020]:   <target dev="vdc" bus="virtio"/>
Nov 30 10:53:30 user nova-compute[75020]:   <serial>6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb</serial>
Nov 30 10:53:30 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 10:53:30 user nova-compute[75020]: </disk>
Nov 30 10:53:30 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:53:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully detached device vdc from instance a709433f-c094-4726-8498-c508e14f9d54 from the persistent domain config.
Nov 30 10:53:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a709433f-c094-4726-8498-c508e14f9d54 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:53:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:53:30 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:30 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:53:30 user nova-compute[75020]:   <target dev="vdc" bus="virtio"/>
Nov 30 10:53:30 user nova-compute[75020]:   <serial>6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb</serial>
Nov 30 10:53:30 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 10:53:30 user nova-compute[75020]: </disk>
Nov 30 10:53:30 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:53:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:53:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsLSuUNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:40 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:40 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:40 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b397f9-1609-464d-9a7b-4cedfb361b59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:53:40 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[da881641-e7e0-4c9d-9a80-e2691f7f744e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9] added
Nov 30 10:53:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfdeea2-18d2-44eb-8f6f-87374db33180]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d509149-9a94-4c61-8256-71750c66db88]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsLSuUNQ {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsLSuUNQ" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[677cf8c3-af7b-47d3-94d1-b8cec6b03545]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsLSuUNQ'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd550dd8-b762-47c1-901a-774e8cc0b399]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde74b92-564f-401a-ba8c-513e3878d6da]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)
Nov 30 10:53:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)
Nov 30 10:53:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ecc249-41f1-4b11-81b4-9a3989da7c72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260]
Nov 30 10:53:40 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca89c42-b494-4823-adda-c049ecf83344]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10634bf-5bd8-4b3f-8a64-61098ca56d8e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)
Nov 30 10:53:40 user nova-compute[75020]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:53:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.503s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] HCTL ('40', '-', '-', 0) found on session 21 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.034s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12c5b24-59fc-4b26-a8fb-ced35e594915]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching for a device in session 21 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsLSuUNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:40 user nova-compute[75020]: INFO nova.compute.manager [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Detaching volume c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:53:41 user nova-compute[75020]: INFO nova.virt.block_device [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Attempting to driver detach volume c0e9c986-bdff-4207-be17-4e996343bee5 from mountpoint /dev/vdb
Nov 30 10:53:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Attempting to detach device vdb from instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:53:41 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:41 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 10:53:41 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:53:41 user nova-compute[75020]:   <serial>c0e9c986-bdff-4207-be17-4e996343bee5</serial>
Nov 30 10:53:41 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 10:53:41 user nova-compute[75020]: </disk>
Nov 30 10:53:41 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully detached device vdb from instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 from the persistent domain config.
Nov 30 10:53:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:53:41 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:41 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 10:53:41 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:53:41 user nova-compute[75020]:   <serial>c0e9c986-bdff-4207-be17-4e996343bee5</serial>
Nov 30 10:53:41 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 10:53:41 user nova-compute[75020]: </disk>
Nov 30 10:53:41 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.569s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== connect_volume: return (1573ms) {'type': 'block', 'scsi_wwn': '26562646338303330', 'path': '/dev/sdi'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562646338303330', 'path': '/dev/sdi'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'flavor' on Instance uuid 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:53:41 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:41 user nova-compute[75020]:   <source dev="/dev/sdi"/>
Nov 30 10:53:41 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:53:41 user nova-compute[75020]:   <serial>8683b106-c46e-48dd-8c38-edc266cd94f9</serial>
Nov 30 10:53:41 user nova-compute[75020]: </disk>
Nov 30 10:53:41 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No VIF found with MAC fa:16:3e:19:a2:5f, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.471s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3d74540c-77e1-47cb-addb-7fa4e5e24aa6 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.316s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 is timed out.
Nov 30 10:53:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully detached device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the live domain config.
Nov 30 10:53:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jimxRdyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:43 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a156d8-b985-48f5-b0ab-a2f05b4279a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:53:43 user nova-compute[75020]: No targets found.
Nov 30 10:53:43 user nova-compute[75020]: iSNS:
Nov 30 10:53:43 user nova-compute[75020]: No targets found.
Nov 30 10:53:43 user nova-compute[75020]: STATIC:
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:53:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:43 user nova-compute[75020]: FIRMWARE:
Nov 30 10:53:43 user nova-compute[75020]: No targets found.
Nov 30 10:53:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:53:43 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:53:43 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4942eb5-0c34-4a43-81c3-ff494cc04b59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc581623-b765-4b58-bbe6-18cf127cb115]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a (non-flash)
Nov 30 10:53:43 user nova-compute[75020]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:53:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad8859cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a'): ({'sdh'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Removing single pathed devices sdh {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.115s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc39677-215e-4003-b0f7-793ed8caae88]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8aa5c-957a-4ee0-a295-db25469b141c]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Flushing IO for device /dev/sdh {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d016e69-207c-44f9-b8ed-1f093b422e94]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1c69ac-59de-4513-b941-304a2b41ce1f]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] SCSI volumes sdh have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0765c94-22aa-4768-b384-0b8ee5773b16]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c8c482-7a05-4f9b-a069-383bc3b2c896]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a, portal: 172.16.0.220,3260]
Nov 30 10:53:43 user nova-compute[75020]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335f6074-9a85-4ea9-90c0-595df0d4fa0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5692588-a648-457f-9957-4396fef25480]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== disconnect_volume: return (476ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:53:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:44 user nova-compute[75020]: INFO nova.compute.manager [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Rebuilding instance
Nov 30 10:53:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.objects.instance [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:53:45 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:53:45 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=6981MB free_disk=25.285400390625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-074d093f-62ff-4d8d-9511-b5ed48005227 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.564s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 88815763-252f-4506-aa0c-5524e8b96e08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 77a73463-ea12-43c3-83a4-803f4a535010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a709433f-c094-4726-8498-c508e14f9d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance fae5310f-5516-4349-ad31-4df9453171a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance c60c81b0-7039-4885-87c1-dbb3e6c744a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 699e178d-3c20-4bae-ae9e-ba337ab6f5d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-929a7cad-2e0c-440a-ac5c-4e5b29191429 req-5d469e60-0bec-468f-93c4-e7982f2c7af4 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-unplugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-929a7cad-2e0c-440a-ac5c-4e5b29191429 req-5d469e60-0bec-468f-93c4-e7982f2c7af4 service nova] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-929a7cad-2e0c-440a-ac5c-4e5b29191429 req-5d469e60-0bec-468f-93c4-e7982f2c7af4 service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-929a7cad-2e0c-440a-ac5c-4e5b29191429 req-5d469e60-0bec-468f-93c4-e7982f2c7af4 service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-929a7cad-2e0c-440a-ac5c-4e5b29191429 req-5d469e60-0bec-468f-93c4-e7982f2c7af4 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] No waiting events found dispatching network-vif-unplugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:45 user nova-compute[75020]: WARNING nova.compute.manager [req-929a7cad-2e0c-440a-ac5c-4e5b29191429 req-5d469e60-0bec-468f-93c4-e7982f2c7af4 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received unexpected event network-vif-unplugged-78557a1a-289d-4be3-b859-f3f8623fd45c for instance with vm_state active and task_state rebuilding.
Nov 30 10:53:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.896s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 10:53:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance destroyed successfully.
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:46 user nova-compute[75020]: INFO nova.compute.manager [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Detaching volume 8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:53:46 user nova-compute[75020]: INFO nova.virt.block_device [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Attempting to driver detach volume 8683b106-c46e-48dd-8c38-edc266cd94f9 from mountpoint /dev/vdb
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Attempting to detach device vdb from instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:53:46 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:53:46 user nova-compute[75020]:   <source dev="/dev/sdi"/>
Nov 30 10:53:46 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:53:46 user nova-compute[75020]:   <serial>8683b106-c46e-48dd-8c38-edc266cd94f9</serial>
Nov 30 10:53:46 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:53:46 user nova-compute[75020]: </disk>
Nov 30 10:53:46 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:53:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully detached device vdb from instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 from the persistent domain config.
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsLSuUNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:46 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd6156b-1ee3-40e1-9f24-e5c13b785ec0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:53:46 user nova-compute[75020]: No targets found.
Nov 30 10:53:46 user nova-compute[75020]: iSNS:
Nov 30 10:53:46 user nova-compute[75020]: No targets found.
Nov 30 10:53:46 user nova-compute[75020]: STATIC:
Nov 30 10:53:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870
Nov 30 10:53:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:53:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:53:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:53:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:53:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:53:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb
Nov 30 10:53:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:53:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:46 user nova-compute[75020]: FIRMWARE:
Nov 30 10:53:46 user nova-compute[75020]: No targets found.
Nov 30 10:53:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:53:46 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:53:46 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[35130ffc-3c15-4d41-a510-04533fc04548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[85997925-c2a1-47c5-99f9-265eb27c094d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:53:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad8867a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9'): ({'sdi'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Removing single pathed devices sdi {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1482efc6-c957-4d35-9890-4afe3725a160]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c851c90-d813-4214-a106-f9b42c5910af]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flushing IO for device /dev/sdi {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4235d01b-d5e5-4d75-8834-899317f8baed]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bba3b5-0756-4f44-8a52-9fb540ede48c]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] SCSI volumes sdi have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21b9d5-63a3-49bc-9c00-e5b9362e000d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a22ed1e-134a-418c-85f6-015eee1700bb]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260]
Nov 30 10:53:46 user nova-compute[75020]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd65098b-0c32-4a62-82e8-5aaaf0005e8f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== disconnect_volume: return (353ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:53:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance destroyed successfully.
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1577208617',display_name='tempest-ServerActionsTestOtherA-server-278695233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1577208617',id=16,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3MNl3vXIHlAfMzsSD6x85put1v2rIbFO9K/J0NJAsxh65y9x1lCMG9kdMXXWUSt8sUghYnnEKtixmuW/zp2tDBop3t0gGhOp7QoNP2SrpDfBfgLTTvhtOaN0iqFAnesA==',key_name='tempest-keypair-800322414',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-7ognsntj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=5e5dcbe8-47e9-4cf8-861b-84f37c1c6608,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_vif [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78557a1a-28, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0b03283-499f-477f-b848-0082a9c4f5c5) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:47 user nova-compute[75020]: INFO os_vif [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28')
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsLSuUNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:47 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ce4f14-9759-4872-b4f7-41e558661d6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:53:47 user nova-compute[75020]: No targets found.
Nov 30 10:53:47 user nova-compute[75020]: iSNS:
Nov 30 10:53:47 user nova-compute[75020]: No targets found.
Nov 30 10:53:47 user nova-compute[75020]: STATIC:
Nov 30 10:53:47 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870
Nov 30 10:53:47 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:47 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:47 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:53:47 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:47 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:47 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:53:47 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:47 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:47 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:53:47 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:47 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:47 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:53:47 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:47 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:47 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb
Nov 30 10:53:47 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:47 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:47 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:53:47 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:47 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:47 user nova-compute[75020]: FIRMWARE:
Nov 30 10:53:47 user nova-compute[75020]: No targets found.
Nov 30 10:53:47 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:53:47 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:53:47 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[474a4b2b-2a7e-4cc8-a552-42beca41e162]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-9623da8f-4cd3-497e-a19b-24bda6077681 req-54649553-9ebc-406d-9dff-cb6937a04fe6 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9623da8f-4cd3-497e-a19b-24bda6077681 req-54649553-9ebc-406d-9dff-cb6937a04fe6 service nova] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9623da8f-4cd3-497e-a19b-24bda6077681 req-54649553-9ebc-406d-9dff-cb6937a04fe6 service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9623da8f-4cd3-497e-a19b-24bda6077681 req-54649553-9ebc-406d-9dff-cb6937a04fe6 service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-9623da8f-4cd3-497e-a19b-24bda6077681 req-54649553-9ebc-406d-9dff-cb6937a04fe6 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] No waiting events found dispatching network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:47 user nova-compute[75020]: WARNING nova.compute.manager [req-9623da8f-4cd3-497e-a19b-24bda6077681 req-54649553-9ebc-406d-9dff-cb6937a04fe6 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received unexpected event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c for instance with vm_state active and task_state rebuilding.
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c13140-31c6-443d-8c26-1c86aa99450a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:47 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88678a60>, {}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Disconnecting from: [] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== disconnect_volume: return (89ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:53:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Deleting instance files /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608_del
Nov 30 10:53:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Deletion of /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608_del complete
Nov 30 10:53:47 user nova-compute[75020]: INFO nova.virt.block_device [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Booting with volume 8683b106-c46e-48dd-8c38-edc266cd94f9 at /dev/vdb
Nov 30 10:53:48 user nova-compute[75020]: DEBUG os_brick.utils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b45eaa9-4d6c-4426-a7ff-aa074fae056e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38affea-3427-4245-9f9a-7a8008240d84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3cb4ac-e162-4de9-9002-74fbe2db74bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[833a8622-8b5f-47d1-93c6-a8cac9840da7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:53:48 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:53:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafc9da4-9302-4313-9c27-d26dbbe07c58]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG os_brick.utils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:48 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Updating existing volume attachment record: f28d6bea-80d5-4925-bbd6-fc9b1a850401 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:53:51 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a709433f-c094-4726-8498-c508e14f9d54 is timed out.
Nov 30 10:53:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully detached device vdc from instance a709433f-c094-4726-8498-c508e14f9d54 from the live domain config.
Nov 30 10:53:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iorwKHEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:51 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffb36e6-65c8-444f-aed3-6358456940aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:53:51 user nova-compute[75020]: No targets found.
Nov 30 10:53:51 user nova-compute[75020]: iSNS:
Nov 30 10:53:51 user nova-compute[75020]: No targets found.
Nov 30 10:53:51 user nova-compute[75020]: STATIC:
Nov 30 10:53:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870
Nov 30 10:53:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:53:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:53:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:53:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:53:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb
Nov 30 10:53:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:53:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:53:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:53:51 user nova-compute[75020]: FIRMWARE:
Nov 30 10:53:51 user nova-compute[75020]: No targets found.
Nov 30 10:53:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:53:51 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:53:51 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8314170-718d-4999-9ff3-ff4e6707110b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4834342c-1840-4e93-a9f4-4a8c137876dc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada87dc310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e550f2eb-d76c-4014-bd76-b55acf1e5e4a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4042ce-1ada-45d4-9f51-ceb4c0528535]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7199bb6-1ee8-4f8c-bc7c-550ad578c521]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1804f8e8-e2f1-4015-9014-d19ab50ef7a3]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94580e8-526a-4668-8407-927caebf8068]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[97811e23-a04e-402a-b170-d155f4b9db83]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb, portal: 172.16.0.220,3260]
Nov 30 10:53:51 user nova-compute[75020]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6723e6fa-c9fa-4adf-bbf4-4e2b4794e3fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e26ad9-017a-4c4a-b68c-8b1ad7032a6e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] <== disconnect_volume: return (361ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:53:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:53:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'flavor' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:56 user nova-compute[75020]: INFO nova.compute.manager [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Terminating instance
Nov 30 10:53:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e4849179-f3d0-4f8c-9ac0-4c268f1d11bd tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.669s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-a3673422-731e-44df-b9a8-732efe741c26 req-69cd30be-4ec0-44e2-b554-84bf9883a418 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received event network-vif-unplugged-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a3673422-731e-44df-b9a8-732efe741c26 req-69cd30be-4ec0-44e2-b554-84bf9883a418 service nova] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a3673422-731e-44df-b9a8-732efe741c26 req-69cd30be-4ec0-44e2-b554-84bf9883a418 service nova] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a3673422-731e-44df-b9a8-732efe741c26 req-69cd30be-4ec0-44e2-b554-84bf9883a418 service nova] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-a3673422-731e-44df-b9a8-732efe741c26 req-69cd30be-4ec0-44e2-b554-84bf9883a418 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] No waiting events found dispatching network-vif-unplugged-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-a3673422-731e-44df-b9a8-732efe741c26 req-69cd30be-4ec0-44e2-b554-84bf9883a418 service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received event network-vif-unplugged-159fa17a-1663-4e44-bd28-074acd3bf84f for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:53:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Instance destroyed successfully.
Nov 30 10:53:57 user nova-compute[75020]: DEBUG nova.objects.instance [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lazy-loading 'resources' on Instance uuid 88815763-252f-4506-aa0c-5524e8b96e08 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2035745060',display_name='tempest-VolumesAdminNegativeTest-server-2035745060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2035745060',id=6,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWDAC4ncLDW+VJj6qJ+/+yLF4ob4PIWUmLQ6lqHg2v5mEJZZVKo1OSs+BQsnwBOe/BlqXYp8dk33G+s9XX+CZ1GxHTsY3yIXcLC+X68aEzBCZKZENUD8aVldgSYmV9U1Q==',key_name='tempest-keypair-1944336700',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='348ee1a2d9e34ce8ad69a57323cbfb45',ramdisk_id='',reservation_id='r-s3mui5tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1613879927',owner_user_name='tempest-VolumesAdminNegativeTest-1613879927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0bf43699eca49558d5605f7912dc32a',uuid=88815763-252f-4506-aa0c-5524e8b96e08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converting VIF {"id": "159fa17a-1663-4e44-bd28-074acd3bf84f", "address": "fa:16:3e:fc:c9:3a", "network": {"id": "f76a0f27-4db5-4b3a-bfd5-da1972ac6289", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1031013703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348ee1a2d9e34ce8ad69a57323cbfb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159fa17a-16", "ovs_interfaceid": "159fa17a-1663-4e44-bd28-074acd3bf84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c9:3a,bridge_name='br-int',has_traffic_filtering=True,id=159fa17a-1663-4e44-bd28-074acd3bf84f,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159fa17a-16') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG os_vif [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c9:3a,bridge_name='br-int',has_traffic_filtering=True,id=159fa17a-1663-4e44-bd28-074acd3bf84f,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159fa17a-16') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap159fa17a-16, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64920d3b-01f9-4354-ba22-e44ff39df614) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:57 user nova-compute[75020]: INFO os_vif [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c9:3a,bridge_name='br-int',has_traffic_filtering=True,id=159fa17a-1663-4e44-bd28-074acd3bf84f,network=Network(f76a0f27-4db5-4b3a-bfd5-da1972ac6289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159fa17a-16')
Nov 30 10:53:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Deleting instance files /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08_del
Nov 30 10:53:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Deletion of /opt/stack/data/nova/instances/88815763-252f-4506-aa0c-5524e8b96e08_del complete
Nov 30 10:53:57 user nova-compute[75020]: INFO nova.compute.manager [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 30 10:53:57 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:53:57 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:53:58 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Took 1.02 seconds to deallocate network for instance.
Nov 30 10:53:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-d009ea35-a683-4f43-bcc2-db63f8919858 req-87495b19-7f7b-42e4-91fc-31932b5f8bab service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received event network-vif-deleted-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:53:58 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Creating image(s)
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-cb2fb853-42f4-427b-bd9b-5a2ba5cb7958 req-3a2429ce-bf92-4780-8c2b-2e3a684f017e service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received event network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb2fb853-42f4-427b-bd9b-5a2ba5cb7958 req-3a2429ce-bf92-4780-8c2b-2e3a684f017e service nova] Acquiring lock "88815763-252f-4506-aa0c-5524e8b96e08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb2fb853-42f4-427b-bd9b-5a2ba5cb7958 req-3a2429ce-bf92-4780-8c2b-2e3a684f017e service nova] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cb2fb853-42f4-427b-bd9b-5a2ba5cb7958 req-3a2429ce-bf92-4780-8c2b-2e3a684f017e service nova] Lock "88815763-252f-4506-aa0c-5524e8b96e08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-cb2fb853-42f4-427b-bd9b-5a2ba5cb7958 req-3a2429ce-bf92-4780-8c2b-2e3a684f017e service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] No waiting events found dispatching network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:53:58 user nova-compute[75020]: WARNING nova.compute.manager [req-cb2fb853-42f4-427b-bd9b-5a2ba5cb7958 req-3a2429ce-bf92-4780-8c2b-2e3a684f017e service nova] [instance: 88815763-252f-4506-aa0c-5524e8b96e08] Received unexpected event network-vif-plugged-159fa17a-1663-4e44-bd28-074acd3bf84f for instance with vm_state deleted and task_state None.
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:58 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Deleted allocations for instance 88815763-252f-4506-aa0c-5524e8b96e08
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-555db123-b2cc-4e46-bb8c-8283d9606542 tempest-VolumesAdminNegativeTest-1613879927 tempest-VolumesAdminNegativeTest-1613879927-project-member] Lock "88815763-252f-4506-aa0c-5524e8b96e08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.584s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.222s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk 1073741824" returned: 0 in 0.047s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Cannot resize image /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Ensure instance console log exists: /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Start _get_guest_xml network_info=[{"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'f28d6bea-80d5-4925-bbd6-fc9b1a850401', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsLSuUNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e5dcbe8-47e9-4cf8-861b-84f37c1c6608', 'attached_at': '', 'detached_at': '', 'volume_id': '8683b106-c46e-48dd-8c38-edc266cd94f9', 'serial': '8683b106-c46e-48dd-8c38-edc266cd94f9'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:53:59 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 10:53:59 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsLSuUNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:53:59 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:59 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:53:59 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fb7a62-5952-4ea5-99d0-369050eed0c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:53:59 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f8f11d-4e05-48e8-a758-b56096fe7f07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9] added
Nov 30 10:53:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f63be7e-3ac7-4ae1-814a-39ca3c03d5dd]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc3727-bb14-4e5b-b749-452e27dfd519]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsLSuUNQ {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsLSuUNQ" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a40db8-8bf0-45aa-8449-08f86f220c82]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsLSuUNQ'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16eab27-686a-4d67-a492-3db68ffa2a8c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0891bf85-40dd-4485-b8b6-d3244a889c1b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f66ac-acd9-471d-9236-cd195d4254b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260]
Nov 30 10:53:59 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260] successful.
Nov 30 10:53:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[560bdb06-e106-4522-b8f8-965b7d03fb5e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[02380861-f2fc-4d36-a32f-48ab8a9f4d7b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:53:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef840953-507d-4c12-afb2-000728719b2e]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:53:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsLSuUNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26562646338303330', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562646338303330', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1577208617',display_name='tempest-ServerActionsTestOtherA-server-278695233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1577208617',id=16,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3MNl3vXIHlAfMzsSD6x85put1v2rIbFO9K/J0NJAsxh65y9x1lCMG9kdMXXWUSt8sUghYnnEKtixmuW/zp2tDBop3t0gGhOp7QoNP2SrpDfBfgLTTvhtOaN0iqFAnesA==',key_name='tempest-keypair-800322414',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-7ognsntj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=5e5dcbe8-47e9-4cf8-861b-84f37c1c6608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:54:00 user nova-compute[75020]:   <uuid>5e5dcbe8-47e9-4cf8-861b-84f37c1c6608</uuid>
Nov 30 10:54:00 user nova-compute[75020]:   <name>instance-00000010</name>
Nov 30 10:54:00 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:54:00 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:54:00 user nova-compute[75020]:   <metadata>
Nov 30 10:54:00 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:54:00 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:54:00 user nova-compute[75020]:       <nova:name>tempest-ServerActionsTestOtherA-server-278695233</nova:name>
Nov 30 10:54:00 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:53:59</nova:creationTime>
Nov 30 10:54:00 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:54:00 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:54:00 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:54:00 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:54:00 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:54:00 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:54:00 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:54:00 user nova-compute[75020]:       <nova:owner>
Nov 30 10:54:00 user nova-compute[75020]:         <nova:user uuid="7f64ef255b2a48349a280bf3693af23f">tempest-ServerActionsTestOtherA-582760806-project-member</nova:user>
Nov 30 10:54:00 user nova-compute[75020]:         <nova:project uuid="e10919b523b740859f3ac98e31468a93">tempest-ServerActionsTestOtherA-582760806</nova:project>
Nov 30 10:54:00 user nova-compute[75020]:       </nova:owner>
Nov 30 10:54:00 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:54:00 user nova-compute[75020]:       <nova:ports>
Nov 30 10:54:00 user nova-compute[75020]:         <nova:port uuid="78557a1a-289d-4be3-b859-f3f8623fd45c">
Nov 30 10:54:00 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 10:54:00 user nova-compute[75020]:         </nova:port>
Nov 30 10:54:00 user nova-compute[75020]:       </nova:ports>
Nov 30 10:54:00 user nova-compute[75020]:     </nova:instance>
Nov 30 10:54:00 user nova-compute[75020]:   </metadata>
Nov 30 10:54:00 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:54:00 user nova-compute[75020]:     <system>
Nov 30 10:54:00 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:54:00 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:54:00 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:54:00 user nova-compute[75020]:       <entry name="serial">5e5dcbe8-47e9-4cf8-861b-84f37c1c6608</entry>
Nov 30 10:54:00 user nova-compute[75020]:       <entry name="uuid">5e5dcbe8-47e9-4cf8-861b-84f37c1c6608</entry>
Nov 30 10:54:00 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:54:00 user nova-compute[75020]:     </system>
Nov 30 10:54:00 user nova-compute[75020]:   </sysinfo>
Nov 30 10:54:00 user nova-compute[75020]:   <os>
Nov 30 10:54:00 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:54:00 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:54:00 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:54:00 user nova-compute[75020]:   </os>
Nov 30 10:54:00 user nova-compute[75020]:   <features>
Nov 30 10:54:00 user nova-compute[75020]:     <acpi/>
Nov 30 10:54:00 user nova-compute[75020]:     <apic/>
Nov 30 10:54:00 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:54:00 user nova-compute[75020]:   </features>
Nov 30 10:54:00 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:54:00 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:54:00 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:54:00 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:54:00 user nova-compute[75020]:   </clock>
Nov 30 10:54:00 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:54:00 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:54:00 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:54:00 user nova-compute[75020]:   </cpu>
Nov 30 10:54:00 user nova-compute[75020]:   <devices>
Nov 30 10:54:00 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:54:00 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:54:00 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk"/>
Nov 30 10:54:00 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:54:00 user nova-compute[75020]:     </disk>
Nov 30 10:54:00 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:54:00 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:54:00 user nova-compute[75020]:       <source dev="/dev/sde"/>
Nov 30 10:54:00 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 10:54:00 user nova-compute[75020]:       <serial>8683b106-c46e-48dd-8c38-edc266cd94f9</serial>
Nov 30 10:54:00 user nova-compute[75020]:     </disk>
Nov 30 10:54:00 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:54:00 user nova-compute[75020]:       <mac address="fa:16:3e:19:a2:5f"/>
Nov 30 10:54:00 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:54:00 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:54:00 user nova-compute[75020]:       <target dev="tap78557a1a-28"/>
Nov 30 10:54:00 user nova-compute[75020]:     </interface>
Nov 30 10:54:00 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:54:00 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/console.log" append="off"/>
Nov 30 10:54:00 user nova-compute[75020]:     </serial>
Nov 30 10:54:00 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:54:00 user nova-compute[75020]:     <video>
Nov 30 10:54:00 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:54:00 user nova-compute[75020]:     </video>
Nov 30 10:54:00 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:54:00 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:54:00 user nova-compute[75020]:     </rng>
Nov 30 10:54:00 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:54:00 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:54:00 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:54:00 user nova-compute[75020]:     </memballoon>
Nov 30 10:54:00 user nova-compute[75020]:   </devices>
Nov 30 10:54:00 user nova-compute[75020]: </domain>
Nov 30 10:54:00 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1577208617',display_name='tempest-ServerActionsTestOtherA-server-278695233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1577208617',id=16,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3MNl3vXIHlAfMzsSD6x85put1v2rIbFO9K/J0NJAsxh65y9x1lCMG9kdMXXWUSt8sUghYnnEKtixmuW/zp2tDBop3t0gGhOp7QoNP2SrpDfBfgLTTvhtOaN0iqFAnesA==',key_name='tempest-keypair-800322414',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-7ognsntj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=5e5dcbe8-47e9-4cf8-861b-84f37c1c6608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG os_vif [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '021a12ba-5a70-5e10-b3d0-154e16661f27', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78557a1a-28, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78557a1a-28, col_values=(('qos', UUID('fbd87e6c-7a7d-41c1-bba9-91e981c85c0e')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78557a1a-28, col_values=(('external_ids', {'iface-id': '78557a1a-289d-4be3-b859-f3f8623fd45c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:a2:5f', 'vm-uuid': '5e5dcbe8-47e9-4cf8-861b-84f37c1c6608'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:00 user nova-compute[75020]: INFO os_vif [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28')
Nov 30 10:54:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No VIF found with MAC fa:16:3e:19:a2:5f, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:54:01 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 is timed out.
Nov 30 10:54:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully detached device vdb from instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 from the live domain config.
Nov 30 10:54:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHZvTnaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:54:01 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0248af6-53aa-44cc-ab75-f04292a052dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:54:01 user nova-compute[75020]: No targets found.
Nov 30 10:54:01 user nova-compute[75020]: iSNS:
Nov 30 10:54:01 user nova-compute[75020]: No targets found.
Nov 30 10:54:01 user nova-compute[75020]: STATIC:
Nov 30 10:54:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870
Nov 30 10:54:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:54:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5
Nov 30 10:54:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:54:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:54:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:54:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:54:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:01 user nova-compute[75020]: FIRMWARE:
Nov 30 10:54:01 user nova-compute[75020]: No targets found.
Nov 30 10:54:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:54:01 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:54:01 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a971065a-5b27-494d-8d7b-3b7896dfc297]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73482dc-8eef-46eb-8aa0-28e0a1e1b3e5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad8867a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5'): ({'sdd'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Removing single pathed devices sdd {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb39c8a-c075-4418-980c-5c18f3e3a086]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[347009d1-066d-4ad0-af34-c2602ba65b9e]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flushing IO for device /dev/sdd {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5c7023-6bec-4636-ae48-7ee671219729]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4c2002-0585-407b-9d03-451d7df04c37]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d88b4a-d358-4db0-bc8a-ecc642a4fe61]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc2e6b7-11f3-4c6f-b8fb-a0cda0209d4c]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260]
Nov 30 10:54:02 user nova-compute[75020]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5, portal: 172.16.0.220,3260] successful.
Nov 30 10:54:02 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e9c986-bdff-4207-be17-4e996343bee5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ce28f-cebd-498d-9b98-39f051f1a789]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== disconnect_volume: return (346ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-e2d1442d-6ed5-4c39-8700-a8f0d4ffb519 req-3a111a19-bbb0-4392-a48a-ccf84523f03b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e2d1442d-6ed5-4c39-8700-a8f0d4ffb519 req-3a111a19-bbb0-4392-a48a-ccf84523f03b service nova] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e2d1442d-6ed5-4c39-8700-a8f0d4ffb519 req-3a111a19-bbb0-4392-a48a-ccf84523f03b service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e2d1442d-6ed5-4c39-8700-a8f0d4ffb519 req-3a111a19-bbb0-4392-a48a-ccf84523f03b service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-e2d1442d-6ed5-4c39-8700-a8f0d4ffb519 req-3a111a19-bbb0-4392-a48a-ccf84523f03b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] No waiting events found dispatching network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:02 user nova-compute[75020]: WARNING nova.compute.manager [req-e2d1442d-6ed5-4c39-8700-a8f0d4ffb519 req-3a111a19-bbb0-4392-a48a-ccf84523f03b service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received unexpected event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c for instance with vm_state active and task_state rebuild_spawning.
Nov 30 10:54:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a51e3aea-f064-4c5a-b408-97db938c3e76 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.009s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a677f01e-d375-4096-ac8d-eb440cf57d9a tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a677f01e-d375-4096-ac8d-eb440cf57d9a tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a677f01e-d375-4096-ac8d-eb440cf57d9a tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a677f01e-d375-4096-ac8d-eb440cf57d9a tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75020) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a677f01e-d375-4096-ac8d-eb440cf57d9a tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-b16d45b6-6c31-4804-9966-8714b7346ac6 req-4d105668-8073-4a0c-96d2-a699ec46147a service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b16d45b6-6c31-4804-9966-8714b7346ac6 req-4d105668-8073-4a0c-96d2-a699ec46147a service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b16d45b6-6c31-4804-9966-8714b7346ac6 req-4d105668-8073-4a0c-96d2-a699ec46147a service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b16d45b6-6c31-4804-9966-8714b7346ac6 req-4d105668-8073-4a0c-96d2-a699ec46147a service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-b16d45b6-6c31-4804-9966-8714b7346ac6 req-4d105668-8073-4a0c-96d2-a699ec46147a service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:03 user nova-compute[75020]: WARNING nova.compute.manager [req-b16d45b6-6c31-4804-9966-8714b7346ac6 req-4d105668-8073-4a0c-96d2-a699ec46147a service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state active and task_state powering-off.
Nov 30 10:54:04 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance destroyed successfully.
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a677f01e-d375-4096-ac8d-eb440cf57d9a tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a677f01e-d375-4096-ac8d-eb440cf57d9a tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.847s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-e5ba3cc7-254b-42d3-a757-aa0153d84dba req-be97827d-4e32-465e-a6cf-a070d38b9091 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e5ba3cc7-254b-42d3-a757-aa0153d84dba req-be97827d-4e32-465e-a6cf-a070d38b9091 service nova] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e5ba3cc7-254b-42d3-a757-aa0153d84dba req-be97827d-4e32-465e-a6cf-a070d38b9091 service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e5ba3cc7-254b-42d3-a757-aa0153d84dba req-be97827d-4e32-465e-a6cf-a070d38b9091 service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-e5ba3cc7-254b-42d3-a757-aa0153d84dba req-be97827d-4e32-465e-a6cf-a070d38b9091 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] No waiting events found dispatching network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:04 user nova-compute[75020]: WARNING nova.compute.manager [req-e5ba3cc7-254b-42d3-a757-aa0153d84dba req-be97827d-4e32-465e-a6cf-a070d38b9091 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received unexpected event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c for instance with vm_state active and task_state rebuild_spawning.
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:54:04 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance spawned successfully.
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:04 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75020) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 10:54:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bdd3b530-45a5-4e40-be20-60a2071de17c tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.108s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-2eb6568d-2a83-4c74-a428-611b46160110 req-626e84ca-7255-47f2-a6ff-dde2a640c0f2 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2eb6568d-2a83-4c74-a428-611b46160110 req-626e84ca-7255-47f2-a6ff-dde2a640c0f2 service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2eb6568d-2a83-4c74-a428-611b46160110 req-626e84ca-7255-47f2-a6ff-dde2a640c0f2 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2eb6568d-2a83-4c74-a428-611b46160110 req-626e84ca-7255-47f2-a6ff-dde2a640c0f2 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-2eb6568d-2a83-4c74-a428-611b46160110 req-626e84ca-7255-47f2-a6ff-dde2a640c0f2 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:05 user nova-compute[75020]: WARNING nova.compute.manager [req-2eb6568d-2a83-4c74-a428-611b46160110 req-626e84ca-7255-47f2-a6ff-dde2a640c0f2 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state stopped and task_state None.
Nov 30 10:54:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:12 user nova-compute[75020]: INFO nova.compute.manager [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Terminating instance
Nov 30 10:54:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e2908d-aa08-413a-93c6-e78a5f576e2c req-155133a6-ef04-4f90-a768-93a02f1841f1 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received event network-vif-unplugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e2908d-aa08-413a-93c6-e78a5f576e2c req-155133a6-ef04-4f90-a768-93a02f1841f1 service nova] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e2908d-aa08-413a-93c6-e78a5f576e2c req-155133a6-ef04-4f90-a768-93a02f1841f1 service nova] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e2908d-aa08-413a-93c6-e78a5f576e2c req-155133a6-ef04-4f90-a768-93a02f1841f1 service nova] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e2908d-aa08-413a-93c6-e78a5f576e2c req-155133a6-ef04-4f90-a768-93a02f1841f1 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] No waiting events found dispatching network-vif-unplugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e2908d-aa08-413a-93c6-e78a5f576e2c req-155133a6-ef04-4f90-a768-93a02f1841f1 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received event network-vif-unplugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:54:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Instance destroyed successfully.
Nov 30 10:54:12 user nova-compute[75020]: DEBUG nova.objects.instance [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lazy-loading 'resources' on Instance uuid 77a73463-ea12-43c3-83a4-803f4a535010 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1069569943',display_name='tempest-TestVolumeSwap-server-1069569943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1069569943',id=7,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA6RgdEXXeMAVF3XJ0bm8ecQPC2qJKO8emzyVQa7Lz4LYeEz5IqZaXu9gXg/ENEh1v2h/W2K4EhFbb8CA9vsWchUE5d9jzxaaNjuFchSoAgRTfX6HzeVcg/1IN4IPpG6w==',key_name='tempest-keypair-1650235237',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='231588d67fc5495c90dd06049fa048e3',ramdisk_id='',reservation_id='r-br143mv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-770012424',owner_user_name='tempest-TestVolumeSwap-770012424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b792f0a481254cbab52e602e26979a4a',uuid=77a73463-ea12-43c3-83a4-803f4a535010,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Converting VIF {"id": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "address": "fa:16:3e:b8:43:61", "network": {"id": "53cfc59e-d2c7-432e-9239-d0f66e201132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-537716371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "231588d67fc5495c90dd06049fa048e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ca90e-cd", "ovs_interfaceid": "a07ca90e-cde9-4f99-891b-3f1a28e95650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:43:61,bridge_name='br-int',has_traffic_filtering=True,id=a07ca90e-cde9-4f99-891b-3f1a28e95650,network=Network(53cfc59e-d2c7-432e-9239-d0f66e201132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ca90e-cd') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_vif [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:43:61,bridge_name='br-int',has_traffic_filtering=True,id=a07ca90e-cde9-4f99-891b-3f1a28e95650,network=Network(53cfc59e-d2c7-432e-9239-d0f66e201132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ca90e-cd') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa07ca90e-cd, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9076617-fd46-4c22-83e2-1481e53c0ec5) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:13 user nova-compute[75020]: INFO os_vif [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:43:61,bridge_name='br-int',has_traffic_filtering=True,id=a07ca90e-cde9-4f99-891b-3f1a28e95650,network=Network(53cfc59e-d2c7-432e-9239-d0f66e201132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ca90e-cd')
Nov 30 10:54:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dukOrZFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '77ca61d2-17b6-4840-9967-47da7e0ac5de'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:54:13 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f5dd53-7768-4c01-a578-268c0594f9bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:54:13 user nova-compute[75020]: No targets found.
Nov 30 10:54:13 user nova-compute[75020]: iSNS:
Nov 30 10:54:13 user nova-compute[75020]: No targets found.
Nov 30 10:54:13 user nova-compute[75020]: STATIC:
Nov 30 10:54:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870
Nov 30 10:54:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:54:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:54:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:54:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de
Nov 30 10:54:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:54:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:13 user nova-compute[75020]: FIRMWARE:
Nov 30 10:54:13 user nova-compute[75020]: No targets found.
Nov 30 10:54:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:54:13 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:54:13 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c2abc-ee97-4420-85da-0b729f06f4b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b791845b-a543-4e82-8016-ed7201d7edab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada8648c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de'): ({'sdj'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Removing single pathed devices sdj {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2dca44-129e-4b1d-b11d-a9155b6c6dc9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae94af8-58a9-403b-a72c-1cc4909b3d3e]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Flushing IO for device /dev/sdj {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3736bd09-f93b-4640-8422-05df12e6e24f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9027b92e-3629-447e-a65c-73910a8079fc]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] SCSI volumes sdj have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9ecbcb-c0a3-44e8-9f55-112831500969]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fac8ef-5765-420d-9fa9-55a75eed6214]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de, portal: 172.16.0.220,3260]
Nov 30 10:54:13 user nova-compute[75020]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de, portal: 172.16.0.220,3260] successful.
Nov 30 10:54:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ca61d2-17b6-4840-9967-47da7e0ac5de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74571c0-8c42-4f7f-b008-d1c633acd4bc]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] <== disconnect_volume: return (385ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:54:13 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Deleting instance files /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010_del
Nov 30 10:54:13 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Deletion of /opt/stack/data/nova/instances/77a73463-ea12-43c3-83a4-803f4a535010_del complete
Nov 30 10:54:13 user nova-compute[75020]: INFO nova.compute.manager [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 30 10:54:13 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:54:13 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:54:14 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:54:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-887c47af-40ab-4096-aa41-c04e6c13356d req-93aa1074-d96d-4d0b-9be1-24886ccf81be service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received event network-vif-deleted-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:14 user nova-compute[75020]: INFO nova.compute.manager [req-887c47af-40ab-4096-aa41-c04e6c13356d req-93aa1074-d96d-4d0b-9be1-24886ccf81be service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Neutron deleted interface a07ca90e-cde9-4f99-891b-3f1a28e95650; detaching it from the instance and deleting it from the info cache
Nov 30 10:54:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-887c47af-40ab-4096-aa41-c04e6c13356d req-93aa1074-d96d-4d0b-9be1-24886ccf81be service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:54:14 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Took 1.00 seconds to deallocate network for instance.
Nov 30 10:54:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-887c47af-40ab-4096-aa41-c04e6c13356d req-93aa1074-d96d-4d0b-9be1-24886ccf81be service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Detach interface failed, port_id=a07ca90e-cde9-4f99-891b-3f1a28e95650, reason: Instance 77a73463-ea12-43c3-83a4-803f4a535010 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:54:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-e92d66d7-48a9-4e68-94bb-3be0e6c0690b req-b12eafee-b7a2-4c58-b9a3-c7115445aef1 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received event network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e92d66d7-48a9-4e68-94bb-3be0e6c0690b req-b12eafee-b7a2-4c58-b9a3-c7115445aef1 service nova] Acquiring lock "77a73463-ea12-43c3-83a4-803f4a535010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e92d66d7-48a9-4e68-94bb-3be0e6c0690b req-b12eafee-b7a2-4c58-b9a3-c7115445aef1 service nova] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e92d66d7-48a9-4e68-94bb-3be0e6c0690b req-b12eafee-b7a2-4c58-b9a3-c7115445aef1 service nova] Lock "77a73463-ea12-43c3-83a4-803f4a535010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-e92d66d7-48a9-4e68-94bb-3be0e6c0690b req-b12eafee-b7a2-4c58-b9a3-c7115445aef1 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] No waiting events found dispatching network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:14 user nova-compute[75020]: WARNING nova.compute.manager [req-e92d66d7-48a9-4e68-94bb-3be0e6c0690b req-b12eafee-b7a2-4c58-b9a3-c7115445aef1 service nova] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Received unexpected event network-vif-plugged-a07ca90e-cde9-4f99-891b-3f1a28e95650 for instance with vm_state active and task_state deleting.
Nov 30 10:54:15 user nova-compute[75020]: INFO nova.compute.manager [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] [instance: 77a73463-ea12-43c3-83a4-803f4a535010] Took 0.99 seconds to detach 1 volumes for instance.
Nov 30 10:54:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:15 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:15 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:54:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:15 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:16 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Deleted allocations for instance 77a73463-ea12-43c3-83a4-803f4a535010
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:16 user nova-compute[75020]: INFO nova.compute.manager [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attaching volume 535b02cf-5778-4b75-9294-3070eeb123b4 to /dev/vdb
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4f2a8fa5-a2ae-4efe-bdef-981248fa172f tempest-TestVolumeSwap-770012424 tempest-TestVolumeSwap-770012424-project-member] Lock "77a73463-ea12-43c3-83a4-803f4a535010" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.948s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG os_brick.utils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8209f44-72db-4998-ab8d-b1a69f2b0300]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce68b8d-015d-46d0-972c-4793618ccebe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69f0d9-dff0-43fe-95b3-700c1ffbfdd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[df99d90c-b8b9-4d25-b30f-72af5432d45a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:54:16 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:54:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52321e2-a3d5-4508-b037-da5b801fdac6]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG os_brick.utils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:54:16 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating existing volume attachment record: 6764ab39-c28d-4211-a47f-09a212b30b27 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:54:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: INFO nova.compute.manager [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Terminating instance
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-f1487386-1284-448a-be77-a0120239adbe req-fe28dd7a-259d-4f4e-a05e-afa61c51f2f1 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-unplugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f1487386-1284-448a-be77-a0120239adbe req-fe28dd7a-259d-4f4e-a05e-afa61c51f2f1 service nova] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f1487386-1284-448a-be77-a0120239adbe req-fe28dd7a-259d-4f4e-a05e-afa61c51f2f1 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f1487386-1284-448a-be77-a0120239adbe req-fe28dd7a-259d-4f4e-a05e-afa61c51f2f1 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-f1487386-1284-448a-be77-a0120239adbe req-fe28dd7a-259d-4f4e-a05e-afa61c51f2f1 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] No waiting events found dispatching network-vif-unplugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-f1487386-1284-448a-be77-a0120239adbe req-fe28dd7a-259d-4f4e-a05e-afa61c51f2f1 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-unplugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-46675a5a-358d-43c0-887a-98562d9fff66 req-291ef00d-b28e-480d-98b7-b808d34aecbc service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-changed-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-46675a5a-358d-43c0-887a-98562d9fff66 req-291ef00d-b28e-480d-98b7-b808d34aecbc service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Refreshing instance network info cache due to event network-changed-3a7eecf5-e982-408c-a25e-885e6d940868. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-46675a5a-358d-43c0-887a-98562d9fff66 req-291ef00d-b28e-480d-98b7-b808d34aecbc service nova] Acquiring lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-46675a5a-358d-43c0-887a-98562d9fff66 req-291ef00d-b28e-480d-98b7-b808d34aecbc service nova] Acquired lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.network.neutron [req-46675a5a-358d-43c0-887a-98562d9fff66 req-291ef00d-b28e-480d-98b7-b808d34aecbc service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Refreshing network info cache for port 3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid d88214a8-f7f1-4735-8faf-611d70a77d9f {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 1c7e9069-f20d-4389-bbe9-5b3702d408e5 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid d7b8ec6d-d309-41dd-bfac-ba8b079fa979 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid c60c81b0-7039-4885-87c1-dbb3e6c744a4 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 699e178d-3c20-4bae-ae9e-ba337ab6f5d1 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "9768f14b-9e34-421e-be7c-e541442814e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "fae5310f-5516-4349-ad31-4df9453171a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "9768f14b-9e34-421e-be7c-e541442814e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "fae5310f-5516-4349-ad31-4df9453171a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.173s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Instance destroyed successfully.
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'resources' on Instance uuid a709433f-c094-4726-8498-c508e14f9d54 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1075430230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1075430230',id=5,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9U8mBMZ0h7K8lJV9407mFRx1E9E6BfrnfMq1FhxGbl9GDd/B4bNbFXcIESnDYN3W4Elef2TabyP8ZrlhZA/5ujoP1+jBUf/HVCektXsUP2ThO2mH0G7f7uCCHkrsaeA==',key_name='tempest-keypair-1856789779',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:52:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-kuebsqbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:52:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=a709433f-c094-4726-8498-c508e14f9d54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "address": "fa:16:3e:c9:00:aa", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b71bc40-4d", "ovs_interfaceid": "4b71bc40-4d85-4dd0-8a0d-f215a4fc070f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG os_vif [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b71bc40-4d, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=784927de-620e-4e7b-bfa5-e440f947144f) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:22 user nova-compute[75020]: INFO os_vif [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4b71bc40-4d85-4dd0-8a0d-f215a4fc070f,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b71bc40-4d')
Nov 30 10:54:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Deleting instance files /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54_del
Nov 30 10:54:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Deletion of /opt/stack/data/nova/instances/a709433f-c094-4726-8498-c508e14f9d54_del complete
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-46675a5a-358d-43c0-887a-98562d9fff66 req-291ef00d-b28e-480d-98b7-b808d34aecbc service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updated VIF entry in instance network info cache for port 3a7eecf5-e982-408c-a25e-885e6d940868. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-46675a5a-358d-43c0-887a-98562d9fff66 req-291ef00d-b28e-480d-98b7-b808d34aecbc service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating instance_info_cache with network_info: [{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-46675a5a-358d-43c0-887a-98562d9fff66 req-291ef00d-b28e-480d-98b7-b808d34aecbc service nova] Releasing lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:54:22 user nova-compute[75020]: INFO nova.compute.manager [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: a709433f-c094-4726-8498-c508e14f9d54] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 10:54:22 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:54:22 user nova-compute[75020]: INFO nova.compute.manager [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] instance snapshotting
Nov 30 10:54:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Beginning live snapshot process
Nov 30 10:54:22 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:54:23 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: a709433f-c094-4726-8498-c508e14f9d54] Took 0.76 seconds to deallocate network for instance.
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json -f qcow2 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json -f qcow2 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:23 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Deleted allocations for instance a709433f-c094-4726-8498-c508e14f9d54
Nov 30 10:54:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-038a3189-076b-41d6-a2ba-8b8b319ca7a4 req-5bcd6f2d-2113-4067-8fdb-b855a01a4be7 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-038a3189-076b-41d6-a2ba-8b8b319ca7a4 req-5bcd6f2d-2113-4067-8fdb-b855a01a4be7 service nova] Acquiring lock "a709433f-c094-4726-8498-c508e14f9d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-038a3189-076b-41d6-a2ba-8b8b319ca7a4 req-5bcd6f2d-2113-4067-8fdb-b855a01a4be7 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-038a3189-076b-41d6-a2ba-8b8b319ca7a4 req-5bcd6f2d-2113-4067-8fdb-b855a01a4be7 service nova] Lock "a709433f-c094-4726-8498-c508e14f9d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-038a3189-076b-41d6-a2ba-8b8b319ca7a4 req-5bcd6f2d-2113-4067-8fdb-b855a01a4be7 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] No waiting events found dispatching network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:23 user nova-compute[75020]: WARNING nova.compute.manager [req-038a3189-076b-41d6-a2ba-8b8b319ca7a4 req-5bcd6f2d-2113-4067-8fdb-b855a01a4be7 service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received unexpected event network-vif-plugged-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f for instance with vm_state deleted and task_state None.
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a02bfc66-49e8-47d5-8c2c-acd03cf011b7 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "a709433f-c094-4726-8498-c508e14f9d54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.384s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "a709433f-c094-4726-8498-c508e14f9d54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.943s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:23 user nova-compute[75020]: INFO nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: a709433f-c094-4726-8498-c508e14f9d54] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "a709433f-c094-4726-8498-c508e14f9d54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.216s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj1gfr_uz/c32115fa3cd04ecdaafa6040e2ce0665.delta 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-a2e7aaf8-8e3c-4181-baa3-a5f70e2fd3e7 req-32e78e19-edc9-4bcb-82e3-e4661282aa3f service nova] [instance: a709433f-c094-4726-8498-c508e14f9d54] Received event network-vif-deleted-4b71bc40-4d85-4dd0-8a0d-f215a4fc070f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj1gfr_uz/c32115fa3cd04ecdaafa6040e2ce0665.delta 1073741824" returned: 0 in 0.053s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 10:54:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:54:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] COPY block job progress, current cursor: 26869760 final cursor: 75563008 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:54:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:54:25 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 10:54:25 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:54:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj1gfr_uz/c32115fa3cd04ecdaafa6040e2ce0665.delta /opt/stack/data/nova/instances/snapshots/tmpj1gfr_uz/c32115fa3cd04ecdaafa6040e2ce0665 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj1gfr_uz/c32115fa3cd04ecdaafa6040e2ce0665.delta /opt/stack/data/nova/instances/snapshots/tmpj1gfr_uz/c32115fa3cd04ecdaafa6040e2ce0665" returned: 0 in 0.416s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Snapshot extracted, beginning image upload
Nov 30 10:54:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fplorzUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:54:26 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:54:26 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:54:26 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[368f724c-74ff-450d-914b-ab6fb7bdc022]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:54:26 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7f999c-49a3-4fd2-ab2f-ebef519d0b02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4] added
Nov 30 10:54:26 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a28c36-2fba-4fff-9262-0eb5e4e90fe9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bff2898-273b-4c8d-8d14-9fc315887ffe]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fplorzUs {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fplorzUs" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd8377-429e-40e4-b65e-d5f278d0126a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fplorzUs'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828cc58-5220-4777-b5c3-36c8a782e433]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e2a372-fe6a-48e8-b9e6-11cc2036b128]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: INFO nova.compute.manager [None req-bf3641b6-7fb6-48b3-b04a-78858bbff314 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Unrescuing
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf3641b6-7fb6-48b3-b04a-78858bbff314 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf3641b6-7fb6-48b3-b04a-78858bbff314 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquired lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bf3641b6-7fb6-48b3-b04a-78858bbff314 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489b40a-a91a-41f3-b48b-d00ebe9f7e6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4, portal: 172.16.0.220,3260]
Nov 30 10:54:26 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4, portal: 172.16.0.220,3260] successful.
Nov 30 10:54:26 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa203e-f1e2-486c-b24c-15ce5598621a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f8ef5-4590-4c06-af1c-bba7890c463d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 (non-flash)
Nov 30 10:54:26 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f9545e-b8d0-4a9a-b62f-43e8ce938661]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:54:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fplorzUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bf3641b6-7fb6-48b3-b04a-78858bbff314 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating instance_info_cache with network_info: [{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf3641b6-7fb6-48b3-b04a-78858bbff314 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Releasing lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bf3641b6-7fb6-48b3-b04a-78858bbff314 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'flavor' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG nova.compute.manager [req-90276813-4a36-4934-997e-7aca4332f153 req-7d347878-43c5-4c13-995d-a4852a190a5b service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-90276813-4a36-4934-997e-7aca4332f153 req-7d347878-43c5-4c13-995d-a4852a190a5b service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-90276813-4a36-4934-997e-7aca4332f153 req-7d347878-43c5-4c13-995d-a4852a190a5b service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-90276813-4a36-4934-997e-7aca4332f153 req-7d347878-43c5-4c13-995d-a4852a190a5b service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG nova.compute.manager [req-90276813-4a36-4934-997e-7aca4332f153 req-7d347878-43c5-4c13-995d-a4852a190a5b service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:27 user nova-compute[75020]: WARNING nova.compute.manager [req-90276813-4a36-4934-997e-7aca4332f153 req-7d347878-43c5-4c13-995d-a4852a190a5b service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state rescued and task_state unrescuing.
Nov 30 10:54:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26339353365306364', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339353365306364', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:54:27 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:54:27 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 10:54:27 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:54:27 user nova-compute[75020]:   <serial>535b02cf-5778-4b75-9294-3070eeb123b4</serial>
Nov 30 10:54:27 user nova-compute[75020]: </disk>
Nov 30 10:54:27 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:54:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance destroyed successfully.
Nov 30 10:54:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:54:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:54:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No VIF found with MAC fa:16:3e:09:53:aa, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:54:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d2ddad01-49a9-41ab-ad8d-64fe8a6a1874 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.343s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.726s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Snapshot image upload complete
Nov 30 10:54:28 user nova-compute[75020]: INFO nova.compute.manager [None req-ccd1e56c-99c1-4e74-a906-581781f5f7d3 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Took 6.01 seconds to snapshot the instance on the hypervisor.
Nov 30 10:54:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-7fba7242-395a-4a76-a60d-b1d441c9bdec req-da6c6c49-8e09-4b00-b5e2-4eedd7603485 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7fba7242-395a-4a76-a60d-b1d441c9bdec req-da6c6c49-8e09-4b00-b5e2-4eedd7603485 service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7fba7242-395a-4a76-a60d-b1d441c9bdec req-da6c6c49-8e09-4b00-b5e2-4eedd7603485 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7fba7242-395a-4a76-a60d-b1d441c9bdec req-da6c6c49-8e09-4b00-b5e2-4eedd7603485 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-7fba7242-395a-4a76-a60d-b1d441c9bdec req-da6c6c49-8e09-4b00-b5e2-4eedd7603485 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:29 user nova-compute[75020]: WARNING nova.compute.manager [req-7fba7242-395a-4a76-a60d-b1d441c9bdec req-da6c6c49-8e09-4b00-b5e2-4eedd7603485 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state rescued and task_state unrescuing.
Nov 30 10:54:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:30 user nova-compute[75020]: INFO nova.compute.manager [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Detaching volume 535b02cf-5778-4b75-9294-3070eeb123b4
Nov 30 10:54:30 user nova-compute[75020]: INFO nova.virt.block_device [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attempting to driver detach volume 535b02cf-5778-4b75-9294-3070eeb123b4 from mountpoint /dev/vdb
Nov 30 10:54:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Attempting to detach device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:54:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:54:30 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:54:30 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 10:54:30 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:54:30 user nova-compute[75020]:   <serial>535b02cf-5778-4b75-9294-3070eeb123b4</serial>
Nov 30 10:54:30 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:54:30 user nova-compute[75020]: </disk>
Nov 30 10:54:30 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:54:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully detached device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the persistent domain config.
Nov 30 10:54:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:54:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:54:30 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:54:30 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 10:54:30 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:54:30 user nova-compute[75020]:   <serial>535b02cf-5778-4b75-9294-3070eeb123b4</serial>
Nov 30 10:54:30 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:54:30 user nova-compute[75020]: </disk>
Nov 30 10:54:30 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:31 user nova-compute[75020]: WARNING nova.compute.manager [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state rescued and task_state unrescuing.
Nov 30 10:54:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:31 user nova-compute[75020]: WARNING nova.compute.manager [req-cccdc1b3-b7e3-45e9-aa2c-eb4095cc34a2 req-3bc305f6-5343-44b9-a152-f9fd7c6a0e29 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state rescued and task_state unrescuing.
Nov 30 10:54:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf3641b6-7fb6-48b3-b04a-78858bbff314 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:54:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:43 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:54:43 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7593MB free_disk=25.298362731933594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance fae5310f-5516-4349-ad31-4df9453171a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance c60c81b0-7039-4885-87c1-dbb3e6c744a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 699e178d-3c20-4bae-ae9e-ba337ab6f5d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:54:44 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:54:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:54:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:54:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:54:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 10:54:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:54:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:54:45 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:54:45 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid d88214a8-f7f1-4735-8faf-611d70a77d9f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updating instance_info_cache with network_info: [{"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:54:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:54:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:54:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:54:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:54:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:49 user nova-compute[75020]: INFO nova.compute.manager [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Terminating instance
Nov 30 10:54:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-de7db4a9-58f7-400b-9e2c-4809eb33cdaa req-3fca2ae1-f770-41ad-aef9-c2cca09ec7a8 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received event network-vif-unplugged-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-de7db4a9-58f7-400b-9e2c-4809eb33cdaa req-3fca2ae1-f770-41ad-aef9-c2cca09ec7a8 service nova] Acquiring lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-de7db4a9-58f7-400b-9e2c-4809eb33cdaa req-3fca2ae1-f770-41ad-aef9-c2cca09ec7a8 service nova] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-de7db4a9-58f7-400b-9e2c-4809eb33cdaa req-3fca2ae1-f770-41ad-aef9-c2cca09ec7a8 service nova] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-de7db4a9-58f7-400b-9e2c-4809eb33cdaa req-3fca2ae1-f770-41ad-aef9-c2cca09ec7a8 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] No waiting events found dispatching network-vif-unplugged-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-de7db4a9-58f7-400b-9e2c-4809eb33cdaa req-3fca2ae1-f770-41ad-aef9-c2cca09ec7a8 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received event network-vif-unplugged-d99de088-f342-4b91-93b6-4a642441f274 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:50 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Instance destroyed successfully.
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.objects.instance [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lazy-loading 'resources' on Instance uuid 699e178d-3c20-4bae-ae9e-ba337ab6f5d1 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1221444370',display_name='tempest-ServersNegativeTestJSON-server-1221444370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1221444370',id=19,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:53:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07be013073c84dd2bb58b842e6257b57',ramdisk_id='',reservation_id='r-h95yhphj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-263556413',owner_user_name='tempest-ServersNegativeTestJSON-263556413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:53:07Z,user_data=None,user_id='0e5b64476e654197817bd4c65a9ff9c3',uuid=699e178d-3c20-4bae-ae9e-ba337ab6f5d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converting VIF {"id": "d99de088-f342-4b91-93b6-4a642441f274", "address": "fa:16:3e:f9:6c:93", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99de088-f3", "ovs_interfaceid": "d99de088-f342-4b91-93b6-4a642441f274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=d99de088-f342-4b91-93b6-4a642441f274,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99de088-f3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG os_vif [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=d99de088-f342-4b91-93b6-4a642441f274,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99de088-f3') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd99de088-f3, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05bdb317-a969-42c1-9151-cd4c7496d7b5) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:50 user nova-compute[75020]: INFO os_vif [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=d99de088-f342-4b91-93b6-4a642441f274,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99de088-f3')
Nov 30 10:54:50 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Deleting instance files /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1_del
Nov 30 10:54:50 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Deletion of /opt/stack/data/nova/instances/699e178d-3c20-4bae-ae9e-ba337ab6f5d1_del complete
Nov 30 10:54:50 user nova-compute[75020]: INFO nova.compute.manager [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 30 10:54:50 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:50 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Took 0.55 seconds to deallocate network for instance.
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-942efd42-221e-41a5-87a3-27a157590cb2 req-567f2a14-f589-471f-8b00-ad3b2521ce7e service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received event network-vif-deleted-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:50 user nova-compute[75020]: INFO nova.compute.manager [req-942efd42-221e-41a5-87a3-27a157590cb2 req-567f2a14-f589-471f-8b00-ad3b2521ce7e service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Neutron deleted interface d99de088-f342-4b91-93b6-4a642441f274; detaching it from the instance and deleting it from the info cache
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-942efd42-221e-41a5-87a3-27a157590cb2 req-567f2a14-f589-471f-8b00-ad3b2521ce7e service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-942efd42-221e-41a5-87a3-27a157590cb2 req-567f2a14-f589-471f-8b00-ad3b2521ce7e service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Detach interface failed, port_id=d99de088-f342-4b91-93b6-4a642441f274, reason: Instance 699e178d-3c20-4bae-ae9e-ba337ab6f5d1 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:51 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Deleted allocations for instance 699e178d-3c20-4bae-ae9e-ba337ab6f5d1
Nov 30 10:54:51 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 is timed out.
Nov 30 10:54:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully detached device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the live domain config.
Nov 30 10:54:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fplorzUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:54:51 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd4f0a-510e-4988-b526-8f4c872a9511]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-af32b1cb-f4fb-4131-9590-e0381ac8840f tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:54:51 user nova-compute[75020]: No targets found.
Nov 30 10:54:51 user nova-compute[75020]: iSNS:
Nov 30 10:54:51 user nova-compute[75020]: No targets found.
Nov 30 10:54:51 user nova-compute[75020]: STATIC:
Nov 30 10:54:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870
Nov 30 10:54:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:54:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:54:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:54:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4
Nov 30 10:54:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:54:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:54:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:54:51 user nova-compute[75020]: FIRMWARE:
Nov 30 10:54:51 user nova-compute[75020]: No targets found.
Nov 30 10:54:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:54:51 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:54:51 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5da92b8-ac6e-4aed-a0d5-e37d1a679730]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[755bd94a-be41-4b12-a2ba-57487d3edce7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 (non-flash)
Nov 30 10:54:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada8198550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4'): ({'sdd'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Removing single pathed devices sdd {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a94e3b0-3292-4875-974f-3ddde03e7d78]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[99595f4c-fcff-4faa-bcd2-a10256055f2f]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Flushing IO for device /dev/sdd {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6561b76a-27f2-4572-b6e0-b1040058a9b3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.107s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce8d8a9-3835-417d-98b3-05324f2d7226]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2cb713-0362-4fb3-ac04-4cd6a51b0459]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ed935-c4ea-4288-a53a-d3528a41c41e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4, portal: 172.16.0.220,3260]
Nov 30 10:54:51 user nova-compute[75020]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4, portal: 172.16.0.220,3260] successful.
Nov 30 10:54:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535b02cf-5778-4b75-9294-3070eeb123b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[238c3cc6-50f0-41de-afb2-8def2bd96076]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== disconnect_volume: return (412ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-829c182f-92dc-4ae2-8c24-abb73ed2796e req-eaab64c2-a317-402c-877f-6af8623e2871 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received event network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-829c182f-92dc-4ae2-8c24-abb73ed2796e req-eaab64c2-a317-402c-877f-6af8623e2871 service nova] Acquiring lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-829c182f-92dc-4ae2-8c24-abb73ed2796e req-eaab64c2-a317-402c-877f-6af8623e2871 service nova] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-829c182f-92dc-4ae2-8c24-abb73ed2796e req-eaab64c2-a317-402c-877f-6af8623e2871 service nova] Lock "699e178d-3c20-4bae-ae9e-ba337ab6f5d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-829c182f-92dc-4ae2-8c24-abb73ed2796e req-eaab64c2-a317-402c-877f-6af8623e2871 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] No waiting events found dispatching network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:54:51 user nova-compute[75020]: WARNING nova.compute.manager [req-829c182f-92dc-4ae2-8c24-abb73ed2796e req-eaab64c2-a317-402c-877f-6af8623e2871 service nova] [instance: 699e178d-3c20-4bae-ae9e-ba337ab6f5d1] Received unexpected event network-vif-plugged-d99de088-f342-4b91-93b6-4a642441f274 for instance with vm_state deleted and task_state None.
Nov 30 10:54:52 user nova-compute[75020]: DEBUG nova.objects.instance [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:54:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3cde3e5e-890e-46c1-b438-405e8b24e8c0 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.834s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:54:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:54:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "13d43551-5590-4e96-a197-fe2556e080c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:02 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:55:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:02 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:55:02 user nova-compute[75020]: INFO nova.compute.claims [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Claim successful on node user
Nov 30 10:55:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:55:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.policy [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cee10a54cf845a6a328df4e9ea4be85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f16bf7c990e4b7c945642594b58584e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:55:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Creating image(s)
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:55:03 user nova-compute[75020]: INFO nova.compute.claims [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Claim successful on node user
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.253s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Successfully created port: e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.230s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk 1073741824" returned: 0 in 0.075s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.690s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:55:04 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Cannot resize image /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Ensure instance console log exists: /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.policy [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cee10a54cf845a6a328df4e9ea4be85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f16bf7c990e4b7c945642594b58584e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:55:04 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Creating image(s)
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Successfully updated port: e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquired lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-6a6fb08d-7ff2-4c50-a276-5eea5dc64a69 req-4dcc0087-7324-4094-84c5-2f1eb5fa715f service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-changed-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-6a6fb08d-7ff2-4c50-a276-5eea5dc64a69 req-4dcc0087-7324-4094-84c5-2f1eb5fa715f service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Refreshing instance network info cache due to event network-changed-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6a6fb08d-7ff2-4c50-a276-5eea5dc64a69 req-4dcc0087-7324-4094-84c5-2f1eb5fa715f service nova] Acquiring lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.226s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk 1073741824" returned: 0 in 0.061s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.218s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updating instance_info_cache with network_info: [{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Successfully created port: b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Releasing lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance network_info: |[{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6a6fb08d-7ff2-4c50-a276-5eea5dc64a69 req-4dcc0087-7324-4094-84c5-2f1eb5fa715f service nova] Acquired lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-6a6fb08d-7ff2-4c50-a276-5eea5dc64a69 req-4dcc0087-7324-4094-84c5-2f1eb5fa715f service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Refreshing network info cache for port e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Start _get_guest_xml network_info=[{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:55:05 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:05 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1477575849',display_name='tempest-ServerRescueNegativeTestJSON-server-1477575849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1477575849',id=20,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-206orr2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:55:04Z,user_data=None,user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=13d43551-5590-4e96-a197-fe2556e080c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:45:1d,bridge_name='br-int',has_traffic_filtering=True,id=e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape987d4f5-0e') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'pci_devices' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:55:05 user nova-compute[75020]:   <uuid>13d43551-5590-4e96-a197-fe2556e080c5</uuid>
Nov 30 10:55:05 user nova-compute[75020]:   <name>instance-00000014</name>
Nov 30 10:55:05 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:55:05 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:55:05 user nova-compute[75020]:   <metadata>
Nov 30 10:55:05 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:55:05 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:55:05 user nova-compute[75020]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1477575849</nova:name>
Nov 30 10:55:05 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:55:05</nova:creationTime>
Nov 30 10:55:05 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:55:05 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:55:05 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:55:05 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:55:05 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:55:05 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:55:05 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:55:05 user nova-compute[75020]:       <nova:owner>
Nov 30 10:55:05 user nova-compute[75020]:         <nova:user uuid="2cee10a54cf845a6a328df4e9ea4be85">tempest-ServerRescueNegativeTestJSON-2071093195-project-member</nova:user>
Nov 30 10:55:05 user nova-compute[75020]:         <nova:project uuid="8f16bf7c990e4b7c945642594b58584e">tempest-ServerRescueNegativeTestJSON-2071093195</nova:project>
Nov 30 10:55:05 user nova-compute[75020]:       </nova:owner>
Nov 30 10:55:05 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:55:05 user nova-compute[75020]:       <nova:ports>
Nov 30 10:55:05 user nova-compute[75020]:         <nova:port uuid="e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0">
Nov 30 10:55:05 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 10:55:05 user nova-compute[75020]:         </nova:port>
Nov 30 10:55:05 user nova-compute[75020]:       </nova:ports>
Nov 30 10:55:05 user nova-compute[75020]:     </nova:instance>
Nov 30 10:55:05 user nova-compute[75020]:   </metadata>
Nov 30 10:55:05 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:55:05 user nova-compute[75020]:     <system>
Nov 30 10:55:05 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:55:05 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:55:05 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:55:05 user nova-compute[75020]:       <entry name="serial">13d43551-5590-4e96-a197-fe2556e080c5</entry>
Nov 30 10:55:05 user nova-compute[75020]:       <entry name="uuid">13d43551-5590-4e96-a197-fe2556e080c5</entry>
Nov 30 10:55:05 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:55:05 user nova-compute[75020]:     </system>
Nov 30 10:55:05 user nova-compute[75020]:   </sysinfo>
Nov 30 10:55:05 user nova-compute[75020]:   <os>
Nov 30 10:55:05 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:55:05 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:55:05 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:55:05 user nova-compute[75020]:   </os>
Nov 30 10:55:05 user nova-compute[75020]:   <features>
Nov 30 10:55:05 user nova-compute[75020]:     <acpi/>
Nov 30 10:55:05 user nova-compute[75020]:     <apic/>
Nov 30 10:55:05 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:55:05 user nova-compute[75020]:   </features>
Nov 30 10:55:05 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:55:05 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:55:05 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:55:05 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:55:05 user nova-compute[75020]:   </clock>
Nov 30 10:55:05 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:55:05 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:55:05 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:55:05 user nova-compute[75020]:   </cpu>
Nov 30 10:55:05 user nova-compute[75020]:   <devices>
Nov 30 10:55:05 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:55:05 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:55:05 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk"/>
Nov 30 10:55:05 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:55:05 user nova-compute[75020]:     </disk>
Nov 30 10:55:05 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:55:05 user nova-compute[75020]:       <mac address="fa:16:3e:58:45:1d"/>
Nov 30 10:55:05 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:55:05 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:55:05 user nova-compute[75020]:       <target dev="tape987d4f5-0e"/>
Nov 30 10:55:05 user nova-compute[75020]:     </interface>
Nov 30 10:55:05 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:55:05 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/console.log" append="off"/>
Nov 30 10:55:05 user nova-compute[75020]:     </serial>
Nov 30 10:55:05 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:55:05 user nova-compute[75020]:     <video>
Nov 30 10:55:05 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:55:05 user nova-compute[75020]:     </video>
Nov 30 10:55:05 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:55:05 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:55:05 user nova-compute[75020]:     </rng>
Nov 30 10:55:05 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:55:05 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:55:05 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:55:05 user nova-compute[75020]:     </memballoon>
Nov 30 10:55:05 user nova-compute[75020]:   </devices>
Nov 30 10:55:05 user nova-compute[75020]: </domain>
Nov 30 10:55:05 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1477575849',display_name='tempest-ServerRescueNegativeTestJSON-server-1477575849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1477575849',id=20,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-206orr2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:55:04Z,user_data=None,user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=13d43551-5590-4e96-a197-fe2556e080c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:45:1d,bridge_name='br-int',has_traffic_filtering=True,id=e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape987d4f5-0e') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG os_vif [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:45:1d,bridge_name='br-int',has_traffic_filtering=True,id=e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape987d4f5-0e') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '628f400e-d7eb-5331-9e9d-619e38b3dde6', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Cannot resize image /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Ensure instance console log exists: /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape987d4f5-0e, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape987d4f5-0e, col_values=(('qos', UUID('5cf256fa-4cd0-48ce-9370-ef61f6ddf85b')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape987d4f5-0e, col_values=(('external_ids', {'iface-id': 'e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:45:1d', 'vm-uuid': '13d43551-5590-4e96-a197-fe2556e080c5'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:05 user nova-compute[75020]: INFO os_vif [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:45:1d,bridge_name='br-int',has_traffic_filtering=True,id=e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape987d4f5-0e')
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No VIF found with MAC fa:16:3e:58:45:1d, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-6a6fb08d-7ff2-4c50-a276-5eea5dc64a69 req-4dcc0087-7324-4094-84c5-2f1eb5fa715f service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updated VIF entry in instance network info cache for port e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-6a6fb08d-7ff2-4c50-a276-5eea5dc64a69 req-4dcc0087-7324-4094-84c5-2f1eb5fa715f service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updating instance_info_cache with network_info: [{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6a6fb08d-7ff2-4c50-a276-5eea5dc64a69 req-4dcc0087-7324-4094-84c5-2f1eb5fa715f service nova] Releasing lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Successfully updated port: b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquired lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updating instance_info_cache with network_info: [{"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Releasing lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Instance network_info: |[{"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Start _get_guest_xml network_info=[{"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:55:06 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:06 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-236943404',display_name='tempest-ServerRescueNegativeTestJSON-server-236943404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-236943404',id=21,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-8q4lqc6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:55:05Z,user_data=None,user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:06 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=b32faceb-68a8-41a0-bb9c-8323823298aa,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32faceb-68') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'pci_devices' on Instance uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:55:07 user nova-compute[75020]:   <uuid>a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f</uuid>
Nov 30 10:55:07 user nova-compute[75020]:   <name>instance-00000015</name>
Nov 30 10:55:07 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:55:07 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:55:07 user nova-compute[75020]:   <metadata>
Nov 30 10:55:07 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:55:07 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:55:07 user nova-compute[75020]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-236943404</nova:name>
Nov 30 10:55:07 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:55:06</nova:creationTime>
Nov 30 10:55:07 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:55:07 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:55:07 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:55:07 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:55:07 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:55:07 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:55:07 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:55:07 user nova-compute[75020]:       <nova:owner>
Nov 30 10:55:07 user nova-compute[75020]:         <nova:user uuid="2cee10a54cf845a6a328df4e9ea4be85">tempest-ServerRescueNegativeTestJSON-2071093195-project-member</nova:user>
Nov 30 10:55:07 user nova-compute[75020]:         <nova:project uuid="8f16bf7c990e4b7c945642594b58584e">tempest-ServerRescueNegativeTestJSON-2071093195</nova:project>
Nov 30 10:55:07 user nova-compute[75020]:       </nova:owner>
Nov 30 10:55:07 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:55:07 user nova-compute[75020]:       <nova:ports>
Nov 30 10:55:07 user nova-compute[75020]:         <nova:port uuid="b32faceb-68a8-41a0-bb9c-8323823298aa">
Nov 30 10:55:07 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 10:55:07 user nova-compute[75020]:         </nova:port>
Nov 30 10:55:07 user nova-compute[75020]:       </nova:ports>
Nov 30 10:55:07 user nova-compute[75020]:     </nova:instance>
Nov 30 10:55:07 user nova-compute[75020]:   </metadata>
Nov 30 10:55:07 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:55:07 user nova-compute[75020]:     <system>
Nov 30 10:55:07 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:55:07 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:55:07 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:55:07 user nova-compute[75020]:       <entry name="serial">a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f</entry>
Nov 30 10:55:07 user nova-compute[75020]:       <entry name="uuid">a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f</entry>
Nov 30 10:55:07 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:55:07 user nova-compute[75020]:     </system>
Nov 30 10:55:07 user nova-compute[75020]:   </sysinfo>
Nov 30 10:55:07 user nova-compute[75020]:   <os>
Nov 30 10:55:07 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:55:07 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:55:07 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:55:07 user nova-compute[75020]:   </os>
Nov 30 10:55:07 user nova-compute[75020]:   <features>
Nov 30 10:55:07 user nova-compute[75020]:     <acpi/>
Nov 30 10:55:07 user nova-compute[75020]:     <apic/>
Nov 30 10:55:07 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:55:07 user nova-compute[75020]:   </features>
Nov 30 10:55:07 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:55:07 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:55:07 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:55:07 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:55:07 user nova-compute[75020]:   </clock>
Nov 30 10:55:07 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:55:07 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:55:07 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:55:07 user nova-compute[75020]:   </cpu>
Nov 30 10:55:07 user nova-compute[75020]:   <devices>
Nov 30 10:55:07 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:55:07 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:55:07 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk"/>
Nov 30 10:55:07 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:55:07 user nova-compute[75020]:     </disk>
Nov 30 10:55:07 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:55:07 user nova-compute[75020]:       <mac address="fa:16:3e:36:6e:06"/>
Nov 30 10:55:07 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:55:07 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:55:07 user nova-compute[75020]:       <target dev="tapb32faceb-68"/>
Nov 30 10:55:07 user nova-compute[75020]:     </interface>
Nov 30 10:55:07 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:55:07 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/console.log" append="off"/>
Nov 30 10:55:07 user nova-compute[75020]:     </serial>
Nov 30 10:55:07 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:55:07 user nova-compute[75020]:     <video>
Nov 30 10:55:07 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:55:07 user nova-compute[75020]:     </video>
Nov 30 10:55:07 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:55:07 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:55:07 user nova-compute[75020]:     </rng>
Nov 30 10:55:07 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:55:07 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:55:07 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:55:07 user nova-compute[75020]:     </memballoon>
Nov 30 10:55:07 user nova-compute[75020]:   </devices>
Nov 30 10:55:07 user nova-compute[75020]: </domain>
Nov 30 10:55:07 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-236943404',display_name='tempest-ServerRescueNegativeTestJSON-server-236943404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-236943404',id=21,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-8q4lqc6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:55:05Z,user_data=None,user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=b32faceb-68a8-41a0-bb9c-8323823298aa,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32faceb-68') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG os_vif [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=b32faceb-68a8-41a0-bb9c-8323823298aa,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32faceb-68') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55de8f4c-30ec-5678-8ba5-4a20307be6b0', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb32faceb-68, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb32faceb-68, col_values=(('qos', UUID('7871e621-c20d-44cb-84a2-77b5fb05232b')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb32faceb-68, col_values=(('external_ids', {'iface-id': 'b32faceb-68a8-41a0-bb9c-8323823298aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6e:06', 'vm-uuid': 'a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: INFO os_vif [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=b32faceb-68a8-41a0-bb9c-8323823298aa,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32faceb-68')
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No VIF found with MAC fa:16:3e:36:6e:06, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-66ab11f8-5bda-446e-8f97-e6cad1306bc9 req-3030f715-5931-449b-a62b-9f3bc87761ab service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-changed-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-66ab11f8-5bda-446e-8f97-e6cad1306bc9 req-3030f715-5931-449b-a62b-9f3bc87761ab service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Refreshing instance network info cache due to event network-changed-b32faceb-68a8-41a0-bb9c-8323823298aa. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-66ab11f8-5bda-446e-8f97-e6cad1306bc9 req-3030f715-5931-449b-a62b-9f3bc87761ab service nova] Acquiring lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-66ab11f8-5bda-446e-8f97-e6cad1306bc9 req-3030f715-5931-449b-a62b-9f3bc87761ab service nova] Acquired lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.network.neutron [req-66ab11f8-5bda-446e-8f97-e6cad1306bc9 req-3030f715-5931-449b-a62b-9f3bc87761ab service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Refreshing network info cache for port b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-2e38a231-bab0-4488-a4a6-d5da1cb6e01d req-941b9c5e-6fc0-4df5-b1fc-3c7fcdb5b4ab service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2e38a231-bab0-4488-a4a6-d5da1cb6e01d req-941b9c5e-6fc0-4df5-b1fc-3c7fcdb5b4ab service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2e38a231-bab0-4488-a4a6-d5da1cb6e01d req-941b9c5e-6fc0-4df5-b1fc-3c7fcdb5b4ab service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2e38a231-bab0-4488-a4a6-d5da1cb6e01d req-941b9c5e-6fc0-4df5-b1fc-3c7fcdb5b4ab service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-2e38a231-bab0-4488-a4a6-d5da1cb6e01d req-941b9c5e-6fc0-4df5-b1fc-3c7fcdb5b4ab service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:07 user nova-compute[75020]: WARNING nova.compute.manager [req-2e38a231-bab0-4488-a4a6-d5da1cb6e01d req-941b9c5e-6fc0-4df5-b1fc-3c7fcdb5b4ab service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state building and task_state spawning.
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:08 user nova-compute[75020]: DEBUG nova.network.neutron [req-66ab11f8-5bda-446e-8f97-e6cad1306bc9 req-3030f715-5931-449b-a62b-9f3bc87761ab service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updated VIF entry in instance network info cache for port b32faceb-68a8-41a0-bb9c-8323823298aa. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:55:08 user nova-compute[75020]: DEBUG nova.network.neutron [req-66ab11f8-5bda-446e-8f97-e6cad1306bc9 req-3030f715-5931-449b-a62b-9f3bc87761ab service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updating instance_info_cache with network_info: [{"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-66ab11f8-5bda-446e-8f97-e6cad1306bc9 req-3030f715-5931-449b-a62b-9f3bc87761ab service nova] Releasing lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-2e052612-8d04-4c69-995b-60b9bcf1d07d req-002f9d7b-04ee-4925-882f-fbcd15fba998 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2e052612-8d04-4c69-995b-60b9bcf1d07d req-002f9d7b-04ee-4925-882f-fbcd15fba998 service nova] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2e052612-8d04-4c69-995b-60b9bcf1d07d req-002f9d7b-04ee-4925-882f-fbcd15fba998 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2e052612-8d04-4c69-995b-60b9bcf1d07d req-002f9d7b-04ee-4925-882f-fbcd15fba998 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-2e052612-8d04-4c69-995b-60b9bcf1d07d req-002f9d7b-04ee-4925-882f-fbcd15fba998 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] No waiting events found dispatching network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:09 user nova-compute[75020]: WARNING nova.compute.manager [req-2e052612-8d04-4c69-995b-60b9bcf1d07d req-002f9d7b-04ee-4925-882f-fbcd15fba998 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received unexpected event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa for instance with vm_state building and task_state spawning.
Nov 30 10:55:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-d518685c-6711-475b-ba0d-ef876c8018dd req-f245a327-4998-47d3-8d8e-7293ff3d7c07 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d518685c-6711-475b-ba0d-ef876c8018dd req-f245a327-4998-47d3-8d8e-7293ff3d7c07 service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d518685c-6711-475b-ba0d-ef876c8018dd req-f245a327-4998-47d3-8d8e-7293ff3d7c07 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d518685c-6711-475b-ba0d-ef876c8018dd req-f245a327-4998-47d3-8d8e-7293ff3d7c07 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-d518685c-6711-475b-ba0d-ef876c8018dd req-f245a327-4998-47d3-8d8e-7293ff3d7c07 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:09 user nova-compute[75020]: WARNING nova.compute.manager [req-d518685c-6711-475b-ba0d-ef876c8018dd req-f245a327-4998-47d3-8d8e-7293ff3d7c07 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state building and task_state spawning.
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:55:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance spawned successfully.
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:10 user nova-compute[75020]: INFO nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Took 7.20 seconds to spawn the instance on the hypervisor.
Nov 30 10:55:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:55:11 user nova-compute[75020]: INFO nova.compute.manager [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Took 8.16 seconds to build instance.
Nov 30 10:55:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e85d7897-fb66-4638-9069-e25cbc9f728b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "13d43551-5590-4e96-a197-fe2556e080c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.252s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:55:11 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Instance spawned successfully.
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-c5037429-3387-4d9e-bfb8-fbeb2366685d req-ee32744f-9219-460d-98cd-f40c7a366d40 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c5037429-3387-4d9e-bfb8-fbeb2366685d req-ee32744f-9219-460d-98cd-f40c7a366d40 service nova] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c5037429-3387-4d9e-bfb8-fbeb2366685d req-ee32744f-9219-460d-98cd-f40c7a366d40 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c5037429-3387-4d9e-bfb8-fbeb2366685d req-ee32744f-9219-460d-98cd-f40c7a366d40 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-c5037429-3387-4d9e-bfb8-fbeb2366685d req-ee32744f-9219-460d-98cd-f40c7a366d40 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] No waiting events found dispatching network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:11 user nova-compute[75020]: WARNING nova.compute.manager [req-c5037429-3387-4d9e-bfb8-fbeb2366685d req-ee32744f-9219-460d-98cd-f40c7a366d40 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received unexpected event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa for instance with vm_state building and task_state spawning.
Nov 30 10:55:11 user nova-compute[75020]: INFO nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 30 10:55:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:55:11 user nova-compute[75020]: INFO nova.compute.manager [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Took 7.56 seconds to build instance.
Nov 30 10:55:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5ed896b5-da43-4b50-a671-ad44d7f2b90c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.753s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:55:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:55:15 user nova-compute[75020]: INFO nova.compute.claims [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Claim successful on node user
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:55:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:55:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Creating image(s)
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.policy [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d431a8177f54de08c3d0c03a3c9ff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0cce29854643d0b730dc664697dee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-06206902-1bb0-4be5-a5fa-59f4e77935c4 req-f9875472-ce12-4801-b99f-538d68bed44d service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-changed-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-06206902-1bb0-4be5-a5fa-59f4e77935c4 req-f9875472-ce12-4801-b99f-538d68bed44d service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing instance network info cache due to event network-changed-a1d31941-4156-494a-8d29-76ca8e68d55c. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06206902-1bb0-4be5-a5fa-59f4e77935c4 req-f9875472-ce12-4801-b99f-538d68bed44d service nova] Acquiring lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06206902-1bb0-4be5-a5fa-59f4e77935c4 req-f9875472-ce12-4801-b99f-538d68bed44d service nova] Acquired lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG nova.network.neutron [req-06206902-1bb0-4be5-a5fa-59f4e77935c4 req-f9875472-ce12-4801-b99f-538d68bed44d service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Refreshing network info cache for port a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.231s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.212s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk 1073741824" returned: 0 in 0.054s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.240s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Cannot resize image /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Ensure instance console log exists: /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-06206902-1bb0-4be5-a5fa-59f4e77935c4 req-f9875472-ce12-4801-b99f-538d68bed44d service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updated VIF entry in instance network info cache for port a1d31941-4156-494a-8d29-76ca8e68d55c. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-06206902-1bb0-4be5-a5fa-59f4e77935c4 req-f9875472-ce12-4801-b99f-538d68bed44d service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [{"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06206902-1bb0-4be5-a5fa-59f4e77935c4 req-f9875472-ce12-4801-b99f-538d68bed44d service nova] Releasing lock "refresh_cache-c60c81b0-7039-4885-87c1-dbb3e6c744a4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:17 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Successfully created port: aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Successfully updated port: aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquired lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating instance_info_cache with network_info: [{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-9d2903bb-d669-4a45-8871-790b1c723916 req-69d7316c-648b-47a8-9af7-d4be9de5e4b3 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-changed-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-9d2903bb-d669-4a45-8871-790b1c723916 req-69d7316c-648b-47a8-9af7-d4be9de5e4b3 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Refreshing instance network info cache due to event network-changed-aefbdff1-5f9b-4314-9563-07ebbe7a0f48. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9d2903bb-d669-4a45-8871-790b1c723916 req-69d7316c-648b-47a8-9af7-d4be9de5e4b3 service nova] Acquiring lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Releasing lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance network_info: |[{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9d2903bb-d669-4a45-8871-790b1c723916 req-69d7316c-648b-47a8-9af7-d4be9de5e4b3 service nova] Acquired lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.neutron [req-9d2903bb-d669-4a45-8871-790b1c723916 req-69d7316c-648b-47a8-9af7-d4be9de5e4b3 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Refreshing network info cache for port aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Start _get_guest_xml network_info=[{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:55:18 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:18 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109579761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109579761',id=22,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT8W1BX6gMXbYVws9p8tXcoITcXJxTreWPXHMfF5zJS5l6GCKJvuxQNpVsLnhTOSaVNYw7JU0Jf3KoOdgKN5djdJQWy923wwzCaW58MAtWPBGq8zdUGuy8trqZ4QBcsEQ==',key_name='tempest-keypair-1490479026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-a1bndffv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=e35772a3-9a06-4ae7-bf6d-e433fee4dee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'pci_devices' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:55:18 user nova-compute[75020]:   <uuid>e35772a3-9a06-4ae7-bf6d-e433fee4dee6</uuid>
Nov 30 10:55:18 user nova-compute[75020]:   <name>instance-00000016</name>
Nov 30 10:55:18 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:55:18 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:55:18 user nova-compute[75020]:   <metadata>
Nov 30 10:55:18 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:55:18 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:55:18 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1109579761</nova:name>
Nov 30 10:55:18 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:55:18</nova:creationTime>
Nov 30 10:55:18 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:55:18 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:55:18 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:55:18 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:55:18 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:55:18 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:55:18 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:55:18 user nova-compute[75020]:       <nova:owner>
Nov 30 10:55:18 user nova-compute[75020]:         <nova:user uuid="5d431a8177f54de08c3d0c03a3c9ff1e">tempest-AttachVolumeShelveTestJSON-1553674360-project-member</nova:user>
Nov 30 10:55:18 user nova-compute[75020]:         <nova:project uuid="0b0cce29854643d0b730dc664697dee7">tempest-AttachVolumeShelveTestJSON-1553674360</nova:project>
Nov 30 10:55:18 user nova-compute[75020]:       </nova:owner>
Nov 30 10:55:18 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:55:18 user nova-compute[75020]:       <nova:ports>
Nov 30 10:55:18 user nova-compute[75020]:         <nova:port uuid="aefbdff1-5f9b-4314-9563-07ebbe7a0f48">
Nov 30 10:55:18 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 10:55:18 user nova-compute[75020]:         </nova:port>
Nov 30 10:55:18 user nova-compute[75020]:       </nova:ports>
Nov 30 10:55:18 user nova-compute[75020]:     </nova:instance>
Nov 30 10:55:18 user nova-compute[75020]:   </metadata>
Nov 30 10:55:18 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:55:18 user nova-compute[75020]:     <system>
Nov 30 10:55:18 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:55:18 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:55:18 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:55:18 user nova-compute[75020]:       <entry name="serial">e35772a3-9a06-4ae7-bf6d-e433fee4dee6</entry>
Nov 30 10:55:18 user nova-compute[75020]:       <entry name="uuid">e35772a3-9a06-4ae7-bf6d-e433fee4dee6</entry>
Nov 30 10:55:18 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:55:18 user nova-compute[75020]:     </system>
Nov 30 10:55:18 user nova-compute[75020]:   </sysinfo>
Nov 30 10:55:18 user nova-compute[75020]:   <os>
Nov 30 10:55:18 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:55:18 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:55:18 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:55:18 user nova-compute[75020]:   </os>
Nov 30 10:55:18 user nova-compute[75020]:   <features>
Nov 30 10:55:18 user nova-compute[75020]:     <acpi/>
Nov 30 10:55:18 user nova-compute[75020]:     <apic/>
Nov 30 10:55:18 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:55:18 user nova-compute[75020]:   </features>
Nov 30 10:55:18 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:55:18 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:55:18 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:55:18 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:55:18 user nova-compute[75020]:   </clock>
Nov 30 10:55:18 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:55:18 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:55:18 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:55:18 user nova-compute[75020]:   </cpu>
Nov 30 10:55:18 user nova-compute[75020]:   <devices>
Nov 30 10:55:18 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:55:18 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:55:18 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk"/>
Nov 30 10:55:18 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:55:18 user nova-compute[75020]:     </disk>
Nov 30 10:55:18 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:55:18 user nova-compute[75020]:       <mac address="fa:16:3e:97:bb:1c"/>
Nov 30 10:55:18 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:55:18 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:55:18 user nova-compute[75020]:       <target dev="tapaefbdff1-5f"/>
Nov 30 10:55:18 user nova-compute[75020]:     </interface>
Nov 30 10:55:18 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:55:18 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/console.log" append="off"/>
Nov 30 10:55:18 user nova-compute[75020]:     </serial>
Nov 30 10:55:18 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:55:18 user nova-compute[75020]:     <video>
Nov 30 10:55:18 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:55:18 user nova-compute[75020]:     </video>
Nov 30 10:55:18 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:55:18 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:55:18 user nova-compute[75020]:     </rng>
Nov 30 10:55:18 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:55:18 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:55:18 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:55:18 user nova-compute[75020]:     </memballoon>
Nov 30 10:55:18 user nova-compute[75020]:   </devices>
Nov 30 10:55:18 user nova-compute[75020]: </domain>
Nov 30 10:55:18 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109579761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109579761',id=22,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT8W1BX6gMXbYVws9p8tXcoITcXJxTreWPXHMfF5zJS5l6GCKJvuxQNpVsLnhTOSaVNYw7JU0Jf3KoOdgKN5djdJQWy923wwzCaW58MAtWPBGq8zdUGuy8trqZ4QBcsEQ==',key_name='tempest-keypair-1490479026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-a1bndffv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=e35772a3-9a06-4ae7-bf6d-e433fee4dee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG os_vif [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '504be693-6a62-5f38-9a9e-9e5843ebf9a1', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaefbdff1-5f, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaefbdff1-5f, col_values=(('qos', UUID('c860a84d-ec5c-4c55-a17e-899c052ff577')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaefbdff1-5f, col_values=(('external_ids', {'iface-id': 'aefbdff1-5f9b-4314-9563-07ebbe7a0f48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:bb:1c', 'vm-uuid': 'e35772a3-9a06-4ae7-bf6d-e433fee4dee6'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:18 user nova-compute[75020]: INFO os_vif [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f')
Nov 30 10:55:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:55:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No VIF found with MAC fa:16:3e:97:bb:1c, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:55:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-9d2903bb-d669-4a45-8871-790b1c723916 req-69d7316c-648b-47a8-9af7-d4be9de5e4b3 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updated VIF entry in instance network info cache for port aefbdff1-5f9b-4314-9563-07ebbe7a0f48. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:55:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-9d2903bb-d669-4a45-8871-790b1c723916 req-69d7316c-648b-47a8-9af7-d4be9de5e4b3 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating instance_info_cache with network_info: [{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9d2903bb-d669-4a45-8871-790b1c723916 req-69d7316c-648b-47a8-9af7-d4be9de5e4b3 service nova] Releasing lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:20 user nova-compute[75020]: INFO nova.compute.manager [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Terminating instance
Nov 30 10:55:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-e4df1203-c204-4422-8931-e0bda9aed9c7 req-400cd2c2-2d98-443c-8d96-8303c2f7f823 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4df1203-c204-4422-8931-e0bda9aed9c7 req-400cd2c2-2d98-443c-8d96-8303c2f7f823 service nova] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4df1203-c204-4422-8931-e0bda9aed9c7 req-400cd2c2-2d98-443c-8d96-8303c2f7f823 service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4df1203-c204-4422-8931-e0bda9aed9c7 req-400cd2c2-2d98-443c-8d96-8303c2f7f823 service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-e4df1203-c204-4422-8931-e0bda9aed9c7 req-400cd2c2-2d98-443c-8d96-8303c2f7f823 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] No waiting events found dispatching network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:20 user nova-compute[75020]: WARNING nova.compute.manager [req-e4df1203-c204-4422-8931-e0bda9aed9c7 req-400cd2c2-2d98-443c-8d96-8303c2f7f823 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received unexpected event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 for instance with vm_state building and task_state spawning.
Nov 30 10:55:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-05916893-548d-4588-bec3-14275e01241c req-44b7b340-2374-4db5-809b-f0f88df8aec8 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-05916893-548d-4588-bec3-14275e01241c req-44b7b340-2374-4db5-809b-f0f88df8aec8 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-05916893-548d-4588-bec3-14275e01241c req-44b7b340-2374-4db5-809b-f0f88df8aec8 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-05916893-548d-4588-bec3-14275e01241c req-44b7b340-2374-4db5-809b-f0f88df8aec8 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-05916893-548d-4588-bec3-14275e01241c req-44b7b340-2374-4db5-809b-f0f88df8aec8 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-unplugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-05916893-548d-4588-bec3-14275e01241c req-44b7b340-2374-4db5-809b-f0f88df8aec8 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-6f5a8338-3da6-4a69-b037-d19dfe083872 req-6fb2bbdc-6676-4046-b0f5-15208eadd8dc service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6f5a8338-3da6-4a69-b037-d19dfe083872 req-6fb2bbdc-6676-4046-b0f5-15208eadd8dc service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6f5a8338-3da6-4a69-b037-d19dfe083872 req-6fb2bbdc-6676-4046-b0f5-15208eadd8dc service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6f5a8338-3da6-4a69-b037-d19dfe083872 req-6fb2bbdc-6676-4046-b0f5-15208eadd8dc service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-6f5a8338-3da6-4a69-b037-d19dfe083872 req-6fb2bbdc-6676-4046-b0f5-15208eadd8dc service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-unplugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-6f5a8338-3da6-4a69-b037-d19dfe083872 req-6fb2bbdc-6676-4046-b0f5-15208eadd8dc service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:55:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Instance destroyed successfully.
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lazy-loading 'resources' on Instance uuid c60c81b0-7039-4885-87c1-dbb3e6c744a4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:a8:50,bridge_name='br-int',has_traffic_filtering=True,id=a1d31941-4156-494a-8d29-76ca8e68d55c,network=Network(6dcd95a6-8dc0-482e-9d98-8a4dde66edd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d31941-41') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:a8:50,bridge_name='br-int',has_traffic_filtering=True,id=a1d31941-4156-494a-8d29-76ca8e68d55c,network=Network(6dcd95a6-8dc0-482e-9d98-8a4dde66edd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d31941-41') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1d31941-41, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f40d79b-e7bd-4caf-a1f7-659dcca9cf32) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: INFO os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:a8:50,bridge_name='br-int',has_traffic_filtering=True,id=a1d31941-4156-494a-8d29-76ca8e68d55c,network=Network(6dcd95a6-8dc0-482e-9d98-8a4dde66edd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d31941-41')
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:48,bridge_name='br-int',has_traffic_filtering=True,id=ce75623d-157b-47ea-ab64-bc60eae638fd,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce75623d-15') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:48,bridge_name='br-int',has_traffic_filtering=True,id=ce75623d-157b-47ea-ab64-bc60eae638fd,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce75623d-15') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce75623d-15, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] No waiting events found dispatching network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:22 user nova-compute[75020]: WARNING nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received unexpected event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 for instance with vm_state building and task_state spawning.
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-unplugged-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-ce75623d-157b-47ea-ab64-bc60eae638fd for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:22 user nova-compute[75020]: WARNING nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-ce75623d-157b-47ea-ab64-bc60eae638fd for instance with vm_state active and task_state deleting.
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-unplugged-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-a1d31941-4156-494a-8d29-76ca8e68d55c for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:22 user nova-compute[75020]: WARNING nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-a1d31941-4156-494a-8d29-76ca8e68d55c for instance with vm_state active and task_state deleting.
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-unplugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:22 user nova-compute[75020]: WARNING nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-592897fa-fa05-4a9a-bbdf-79463cfe1fef for instance with vm_state active and task_state deleting.
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-unplugged-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-73a7bf18-58e6-4099-a4e4-163c9d03a90f req-9827df37-a63d-4f20-909b-291ae39fce5c service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-be6010c8-ff87-41a5-90e1-bc6841d37eca for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e5fd72b-c666-4160-ba8d-a16eaf4ad7fc) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: INFO os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:48,bridge_name='br-int',has_traffic_filtering=True,id=ce75623d-157b-47ea-ab64-bc60eae638fd,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce75623d-15')
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:35:7a,bridge_name='br-int',has_traffic_filtering=True,id=592897fa-fa05-4a9a-bbdf-79463cfe1fef,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap592897fa-fa') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:35:7a,bridge_name='br-int',has_traffic_filtering=True,id=592897fa-fa05-4a9a-bbdf-79463cfe1fef,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap592897fa-fa') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap592897fa-fa, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:55:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance spawned successfully.
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87647ede-18ed-41af-b74c-79332ee22cae) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: INFO os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:35:7a,bridge_name='br-int',has_traffic_filtering=True,id=592897fa-fa05-4a9a-bbdf-79463cfe1fef,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap592897fa-fa')
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:4b,bridge_name='br-int',has_traffic_filtering=True,id=e9e87fc6-6f34-4260-aa9b-4ba4fa624d83,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e87fc6-6f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:4b,bridge_name='br-int',has_traffic_filtering=True,id=e9e87fc6-6f34-4260-aa9b-4ba4fa624d83,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e87fc6-6f') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:55:23 user nova-compute[75020]: INFO nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9e87fc6-6f, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd988f1d-af55-4971-8a16-ff23570d7ab2) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: INFO os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:4b,bridge_name='br-int',has_traffic_filtering=True,id=e9e87fc6-6f34-4260-aa9b-4ba4fa624d83,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e87fc6-6f')
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "address": "fa:16:3e:0b:f7:02", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6010c8-ff", "ovs_interfaceid": "be6010c8-ff87-41a5-90e1-bc6841d37eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=be6010c8-ff87-41a5-90e1-bc6841d37eca,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6010c8-ff') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=be6010c8-ff87-41a5-90e1-bc6841d37eca,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6010c8-ff') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe6010c8-ff, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: INFO nova.compute.manager [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Took 7.93 seconds to build instance.
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0a2e027a-8896-4147-b631-37bc3f6e5f58 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.064s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:23 user nova-compute[75020]: WARNING nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 for instance with vm_state active and task_state deleting.
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-unplugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-unplugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:23 user nova-compute[75020]: WARNING nova.compute.manager [req-4f6b2150-a3a8-4095-831a-85819a957328 req-fc9eb696-c784-4c62-a202-836cd9d40718 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-3751513a-9c1a-4b65-b5a2-53c8021b37bb for instance with vm_state active and task_state deleting.
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3117423a-ca6b-4965-9d1d-3958244cb58d) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: INFO os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=be6010c8-ff87-41a5-90e1-bc6841d37eca,network=Network(a1c352a9-8dcf-4094-aff4-971c119709e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6010c8-ff')
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:10:72,bridge_name='br-int',has_traffic_filtering=True,id=3751513a-9c1a-4b65-b5a2-53c8021b37bb,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3751513a-9c') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:10:72,bridge_name='br-int',has_traffic_filtering=True,id=3751513a-9c1a-4b65-b5a2-53c8021b37bb,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3751513a-9c') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3751513a-9c, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f250a1bf-73d0-4bfe-b8e3-11f5a06061e7) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: INFO os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:10:72,bridge_name='br-int',has_traffic_filtering=True,id=3751513a-9c1a-4b65-b5a2-53c8021b37bb,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3751513a-9c')
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T10:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162003227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162003227',id=18,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3ppb26y8uFfEM+swcjhU0TrVKLy0R8AcjzHvJ4BkAQdFWQUMgX+Zk5BSxZ0ClBrySfX1DZhDBgRIjgRMYYABlrm89uhk2H33KUhDbAt0xg0FfkShHFs3SuC7tkV3qkBA==',key_name='tempest-keypair-1542544782',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2bb1b67a71e4a2a93627458172d7d09',ramdisk_id='',reservation_id='r-ftzs4f15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1539700782',owner_user_name='tempest-TaggedBootDevicesTest-1539700782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9540302fa89436f950812bd909b60a0',uuid=c60c81b0-7039-4885-87c1-dbb3e6c744a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converting VIF {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0f:b7,bridge_name='br-int',has_traffic_filtering=True,id=cd6730ce-79e3-4a22-a797-ab4a5a91f519,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6730ce-79') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0f:b7,bridge_name='br-int',has_traffic_filtering=True,id=cd6730ce-79e3-4a22-a797-ab4a5a91f519,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6730ce-79') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd6730ce-79, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bb9bb0c-0e0e-427c-8027-53502b743676) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:23 user nova-compute[75020]: INFO os_vif [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0f:b7,bridge_name='br-int',has_traffic_filtering=True,id=cd6730ce-79e3-4a22-a797-ab4a5a91f519,network=Network(84d92055-c6a2-430b-8b78-5d51a819a7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6730ce-79')
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkyMNdWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:55:23 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0741ac0c-32c6-4c0f-99b0-cbe1f5d2abed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:55:23 user nova-compute[75020]: No targets found.
Nov 30 10:55:23 user nova-compute[75020]: iSNS:
Nov 30 10:55:23 user nova-compute[75020]: No targets found.
Nov 30 10:55:23 user nova-compute[75020]: STATIC:
Nov 30 10:55:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870
Nov 30 10:55:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:55:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:55:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:55:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:55:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:23 user nova-compute[75020]: FIRMWARE:
Nov 30 10:55:23 user nova-compute[75020]: No targets found.
Nov 30 10:55:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:55:23 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:55:23 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b52cf-fe67-46cf-9f30-1aa0f5788dde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-28008417-190d-4c87-90f0-52da51434237 req-05c42247-dd08-420e-b4d5-8dc7b0854405 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-28008417-190d-4c87-90f0-52da51434237 req-05c42247-dd08-420e-b4d5-8dc7b0854405 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-28008417-190d-4c87-90f0-52da51434237 req-05c42247-dd08-420e-b4d5-8dc7b0854405 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-28008417-190d-4c87-90f0-52da51434237 req-05c42247-dd08-420e-b4d5-8dc7b0854405 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-28008417-190d-4c87-90f0-52da51434237 req-05c42247-dd08-420e-b4d5-8dc7b0854405 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:23 user nova-compute[75020]: WARNING nova.compute.manager [req-28008417-190d-4c87-90f0-52da51434237 req-05c42247-dd08-420e-b4d5-8dc7b0854405 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-cd6730ce-79e3-4a22-a797-ab4a5a91f519 for instance with vm_state active and task_state deleting.
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5e9e8d-28cb-48a9-9bc5-c87dcfeeeaa8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada864b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f857285e-74dc-4cd2-8f54-ecc525f81629]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97467ca-9e51-4f19-a890-bbfb03894cfa]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e3f68-01d3-43d4-a0a9-93ffebe20764]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[048438d5-49bc-4802-a276-80f1027f7eb2]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc6e5ef6c-a8b28160da6b5172', '/dev/disk/by-id/scsi-26138623238313630', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c6e5ef6c') {{(pid=86371) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 10:55:24 user nova-compute[75020]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc6e5ef6c-a8b28160da6b5172
Nov 30 10:55:24 user nova-compute[75020]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26138623238313630
Nov 30 10:55:24 user nova-compute[75020]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c6e5ef6c
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe1ecf-553c-4e2f-86cc-741b7aa362f9]: (4, None) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bbf6ec-72d5-4e4f-96c3-a2298977b58e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[54691153-2a1f-460a-b77e-bb217e4a2e14]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870, portal: 172.16.0.220,3260]
Nov 30 10:55:24 user nova-compute[75020]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870, portal: 172.16.0.220,3260] successful.
Nov 30 10:55:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7b1dc3-77db-4e41-b4b2-8b0b60703870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe72568-0152-44c4-9635-10d9bb9ddacf]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== disconnect_volume: return (466ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWropJYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:55:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83dc491-b0ec-4a77-acbe-eeb65115480c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:55:24 user nova-compute[75020]: No targets found.
Nov 30 10:55:24 user nova-compute[75020]: iSNS:
Nov 30 10:55:24 user nova-compute[75020]: No targets found.
Nov 30 10:55:24 user nova-compute[75020]: STATIC:
Nov 30 10:55:24 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:55:24 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:24 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:24 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92
Nov 30 10:55:24 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:24 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:24 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:55:24 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:24 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:24 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:55:24 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:24 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:24 user nova-compute[75020]: FIRMWARE:
Nov 30 10:55:24 user nova-compute[75020]: No targets found.
Nov 30 10:55:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:55:24 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:55:24 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[807739a6-51ab-41ed-b840-1c37fb863c78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2f536a-e715-42b6-8bb0-14aa7f369422]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada864b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92'): ({'sdf'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Removing single pathed devices sdf {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0529084-e758-4c78-b604-de135f4b4790]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9318aa-15cb-4579-9372-31fc67a8d902]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Flushing IO for device /dev/sdf {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7d4f48-9c35-4638-9491-c278890ac665]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.076s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8cb68d-d367-48a4-ac24-54f9215849d1]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] SCSI volumes sdf have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b64458-cff6-4eee-bc4f-1944684f8956]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f189a548-c961-4333-a665-34b0235b070f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92, portal: 172.16.0.220,3260]
Nov 30 10:55:24 user nova-compute[75020]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92, portal: 172.16.0.220,3260] successful.
Nov 30 10:55:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc6b810-305d-4e3f-936e-3f292a3bac92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[53930973-60e2-4a65-b5e4-386026dd09c8]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== disconnect_volume: return (439ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlhvKsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:55:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ca5252-0139-49bf-a75a-cdcc6afc1e9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:55:24 user nova-compute[75020]: No targets found.
Nov 30 10:55:24 user nova-compute[75020]: iSNS:
Nov 30 10:55:24 user nova-compute[75020]: No targets found.
Nov 30 10:55:24 user nova-compute[75020]: STATIC:
Nov 30 10:55:24 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031
Nov 30 10:55:24 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:24 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:24 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:55:24 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:24 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:24 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:55:24 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:55:24 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:55:24 user nova-compute[75020]: FIRMWARE:
Nov 30 10:55:24 user nova-compute[75020]: No targets found.
Nov 30 10:55:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:55:24 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:55:24 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35798cf-0d04-45a1-9f8f-b2b9c083b47a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77f78ae-10bb-48cc-ac9c-744f078f952f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada87dcf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031'): ({'sdg'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Removing single pathed devices sdg {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac54d7e8-292d-4d81-b482-5c5baa03ad02]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.039s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aad77c-e605-40d2-bd1c-61e333343d8f]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Flushing IO for device /dev/sdg {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3089c07a-8436-4c90-be9a-a477c8c78c3f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fbb1bc-79a3-452e-bc2b-8f9d077461de]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] SCSI volumes sdg have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-21a373c9-f074-4b15-aeb9-8dba78a18662 req-7fff52f7-587b-40f4-aa06-d0564f0aa494 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-21a373c9-f074-4b15-aeb9-8dba78a18662 req-7fff52f7-587b-40f4-aa06-d0564f0aa494 service nova] Acquiring lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-21a373c9-f074-4b15-aeb9-8dba78a18662 req-7fff52f7-587b-40f4-aa06-d0564f0aa494 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-21a373c9-f074-4b15-aeb9-8dba78a18662 req-7fff52f7-587b-40f4-aa06-d0564f0aa494 service nova] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-21a373c9-f074-4b15-aeb9-8dba78a18662 req-7fff52f7-587b-40f4-aa06-d0564f0aa494 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] No waiting events found dispatching network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:24 user nova-compute[75020]: WARNING nova.compute.manager [req-21a373c9-f074-4b15-aeb9-8dba78a18662 req-7fff52f7-587b-40f4-aa06-d0564f0aa494 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received unexpected event network-vif-plugged-be6010c8-ff87-41a5-90e1-bc6841d37eca for instance with vm_state active and task_state deleting.
Nov 30 10:55:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e8290-6184-42dd-970e-d1cd99a80edd]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b404a-88f3-4c04-b66a-1ad93fc038f1]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031, portal: 172.16.0.220,3260]
Nov 30 10:55:25 user nova-compute[75020]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031, portal: 172.16.0.220,3260] successful.
Nov 30 10:55:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa04b94b-b46f-4e90-93bf-8e56e775b031 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0947434-b74b-4d07-9265-2331a9e0d3c1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] <== disconnect_volume: return (398ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:55:25 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Deleting instance files /opt/stack/data/nova/instances/c60c81b0-7039-4885-87c1-dbb3e6c744a4_del
Nov 30 10:55:25 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Deletion of /opt/stack/data/nova/instances/c60c81b0-7039-4885-87c1-dbb3e6c744a4_del complete
Nov 30 10:55:25 user nova-compute[75020]: INFO nova.compute.manager [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Took 4.88 seconds to destroy the instance on the hypervisor.
Nov 30 10:55:25 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:55:25 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:55:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-6a0ccbf4-6ff9-4cef-be0e-00a3dcd09903 req-eb910a90-91ba-4b8b-8787-819412007bb5 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-deleted-be6010c8-ff87-41a5-90e1-bc6841d37eca {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:28 user nova-compute[75020]: INFO nova.compute.manager [req-6a0ccbf4-6ff9-4cef-be0e-00a3dcd09903 req-eb910a90-91ba-4b8b-8787-819412007bb5 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Neutron deleted interface be6010c8-ff87-41a5-90e1-bc6841d37eca; detaching it from the instance and deleting it from the info cache
Nov 30 10:55:28 user nova-compute[75020]: DEBUG nova.network.neutron [req-6a0ccbf4-6ff9-4cef-be0e-00a3dcd09903 req-eb910a90-91ba-4b8b-8787-819412007bb5 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [{"id": "a1d31941-4156-494a-8d29-76ca8e68d55c", "address": "fa:16:3e:dd:a8:50", "network": {"id": "6dcd95a6-8dc0-482e-9d98-8a4dde66edd9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1908587159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d31941-41", "ovs_interfaceid": "a1d31941-4156-494a-8d29-76ca8e68d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce75623d-157b-47ea-ab64-bc60eae638fd", "address": "fa:16:3e:64:d0:48", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce75623d-15", "ovs_interfaceid": "ce75623d-157b-47ea-ab64-bc60eae638fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "address": "fa:16:3e:c0:35:7a", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592897fa-fa", "ovs_interfaceid": "592897fa-fa05-4a9a-bbdf-79463cfe1fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "address": "fa:16:3e:a5:04:4b", "network": {"id": "a1c352a9-8dcf-4094-aff4-971c119709e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2120884892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e87fc6-6f", "ovs_interfaceid": "e9e87fc6-6f34-4260-aa9b-4ba4fa624d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "address": "fa:16:3e:72:10:72", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3751513a-9c", "ovs_interfaceid": "3751513a-9c1a-4b65-b5a2-53c8021b37bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "address": "fa:16:3e:1f:0f:b7", "network": {"id": "84d92055-c6a2-430b-8b78-5d51a819a7ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1476991363", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a2bb1b67a71e4a2a93627458172d7d09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6730ce-79", "ovs_interfaceid": "cd6730ce-79e3-4a22-a797-ab4a5a91f519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-6a0ccbf4-6ff9-4cef-be0e-00a3dcd09903 req-eb910a90-91ba-4b8b-8787-819412007bb5 service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Detach interface failed, port_id=be6010c8-ff87-41a5-90e1-bc6841d37eca, reason: Instance c60c81b0-7039-4885-87c1-dbb3e6c744a4 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG nova.objects.instance [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:28 user nova-compute[75020]: INFO nova.compute.manager [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attaching volume 572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 to /dev/vdb
Nov 30 10:55:28 user nova-compute[75020]: DEBUG os_brick.utils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6f1cb6-a04e-4119-b113-b1f1a8c67add]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f74fcc-ff3b-4064-9aa2-3a183f3c03b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c34ff-6f57-4788-bd15-5098d2fade41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e269eda-f596-4592-9cad-e73fd736d078]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:55:29 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:55:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb833c0a-0681-45e2-bc75-297eb522c21a]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG os_brick.utils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating existing volume attachment record: e01bd46f-d09f-4c9b-b7be-7edffa1cb642 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:55:29 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:29 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Took 4.69 seconds to deallocate network for instance.
Nov 30 10:55:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-4603cc50-ae3c-4ba1-a47f-79a68725a9af req-c3359864-99cd-4bc0-a249-10e3da3a3e4a service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-deleted-a1d31941-4156-494a-8d29-76ca8e68d55c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-4603cc50-ae3c-4ba1-a47f-79a68725a9af req-c3359864-99cd-4bc0-a249-10e3da3a3e4a service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-deleted-e9e87fc6-6f34-4260-aa9b-4ba4fa624d83 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-4603cc50-ae3c-4ba1-a47f-79a68725a9af req-c3359864-99cd-4bc0-a249-10e3da3a3e4a service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-deleted-cd6730ce-79e3-4a22-a797-ab4a5a91f519 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-4603cc50-ae3c-4ba1-a47f-79a68725a9af req-c3359864-99cd-4bc0-a249-10e3da3a3e4a service nova] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Received event network-vif-deleted-3751513a-9c1a-4b65-b5a2-53c8021b37bb {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:32 user nova-compute[75020]: INFO nova.compute.manager [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] [instance: c60c81b0-7039-4885-87c1-dbb3e6c744a4] Took 2.37 seconds to detach 3 volumes for instance.
Nov 30 10:55:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:32 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:55:32 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:55:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:32 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Deleted allocations for instance c60c81b0-7039-4885-87c1-dbb3e6c744a4
Nov 30 10:55:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a1f8e55c-8719-4da1-8deb-a9470020a36c tempest-TaggedBootDevicesTest-1539700782 tempest-TaggedBootDevicesTest-1539700782-project-member] Lock "c60c81b0-7039-4885-87c1-dbb3e6c744a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.562s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:40 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnjugBaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:55:44 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:55:44 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:55:44 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f67448f-ab67-4619-88b5-afce026d0fcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:55:44 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c343e93-d45c-4ab4-bdbe-b5fb89a5c400]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304] added
Nov 30 10:55:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[246d76bf-d0e2-4485-9db9-09c3f6c3d7b0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[164ef413-439f-4d08-983b-f6615155e28e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnjugBaK {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnjugBaK" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9d82ba-d7f4-4903-9d37-263816737aa9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnjugBaK'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145d6b7-9a1c-45e2-95ba-13f86a102a36]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4408b0da-8d0d-4f31-8cdd-e1aeaec5675c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:44 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:44 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55468ad-cc63-442e-a81b-af702a30941d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304, portal: 172.16.0.220,3260]
Nov 30 10:55:45 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304, portal: 172.16.0.220,3260] successful.
Nov 30 10:55:45 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b7d7c6-6fd1-46d6-b99c-64340bb441d6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dfb276-0b53-4686-8700-d418abca3f81]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:45 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:45 user nova-compute[75020]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 (non-flash)
Nov 30 10:55:45 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:55:45 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:55:45 user nova-compute[75020]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 (non-flash)
Nov 30 10:55:45 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f27fe0-3948-4422-ac52-a7eb7c4ac664]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnjugBaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:55:45 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:45 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7579MB free_disk=25.221538543701172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance fae5310f-5516-4349-ad31-4df9453171a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e35772a3-9a06-4ae7-bf6d-e433fee4dee6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:55:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26531653764343134', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531653764343134', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.objects.instance [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:55:46 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:55:46 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:55:46 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:55:46 user nova-compute[75020]:   <serial>572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304</serial>
Nov 30 10:55:46 user nova-compute[75020]: </disk>
Nov 30 10:55:46 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] No VIF found with MAC fa:16:3e:09:53:aa, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:55:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7089e194-8da2-431a-aff6-a9455bc36318 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.138s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:55:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating instance_info_cache with network_info: [{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:48 user nova-compute[75020]: INFO nova.compute.manager [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Detaching volume 572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304
Nov 30 10:55:48 user nova-compute[75020]: INFO nova.virt.block_device [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Attempting to driver detach volume 572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 from mountpoint /dev/vdb
Nov 30 10:55:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Attempting to detach device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:55:48 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:55:48 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:55:48 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:55:48 user nova-compute[75020]:   <serial>572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304</serial>
Nov 30 10:55:48 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:55:48 user nova-compute[75020]: </disk>
Nov 30 10:55:48 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:55:48 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully detached device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the persistent domain config.
Nov 30 10:55:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:55:48 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:55:48 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:55:48 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:55:48 user nova-compute[75020]:   <serial>572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304</serial>
Nov 30 10:55:48 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:55:48 user nova-compute[75020]: </disk>
Nov 30 10:55:48 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:55:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:55:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:54 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:55:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquired lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:55:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:55:54 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'info_cache' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:54 user nova-compute[75020]: DEBUG nova.objects.base [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:55:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.network.neutron [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating instance_info_cache with network_info: [{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Releasing lock "refresh_cache-829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:55:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance destroyed successfully.
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'resources' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG os_vif [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3370635-c4, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33b155e7-3fe9-4294-8a33-3f6196b10ea8) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:55 user nova-compute[75020]: INFO os_vif [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4')
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Start _get_guest_xml network_info=[{"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'numa_topology' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:55:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'pci_devices' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:55:55 user nova-compute[75020]:   <uuid>829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</uuid>
Nov 30 10:55:55 user nova-compute[75020]:   <name>instance-00000002</name>
Nov 30 10:55:55 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:55:55 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:55:55 user nova-compute[75020]:   <metadata>
Nov 30 10:55:55 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:55:55 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:55:55 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeTestJSON-server-885363355</nova:name>
Nov 30 10:55:55 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:55:55</nova:creationTime>
Nov 30 10:55:55 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:55:55 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:55:55 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:55:55 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:55:55 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:55:55 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:55:55 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:55:55 user nova-compute[75020]:       <nova:owner>
Nov 30 10:55:55 user nova-compute[75020]:         <nova:user uuid="007e7cb60a1540c0a4168b27b2c92e0b">tempest-AttachVolumeTestJSON-1562861090-project-member</nova:user>
Nov 30 10:55:55 user nova-compute[75020]:         <nova:project uuid="c2765886644e4b5eb42a29eb8c0a82e1">tempest-AttachVolumeTestJSON-1562861090</nova:project>
Nov 30 10:55:55 user nova-compute[75020]:       </nova:owner>
Nov 30 10:55:55 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:55:55 user nova-compute[75020]:       <nova:ports>
Nov 30 10:55:55 user nova-compute[75020]:         <nova:port uuid="d3370635-c4d4-4dc7-8a3c-a3dd2756dff0">
Nov 30 10:55:55 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 10:55:55 user nova-compute[75020]:         </nova:port>
Nov 30 10:55:55 user nova-compute[75020]:       </nova:ports>
Nov 30 10:55:55 user nova-compute[75020]:     </nova:instance>
Nov 30 10:55:55 user nova-compute[75020]:   </metadata>
Nov 30 10:55:55 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:55:55 user nova-compute[75020]:     <system>
Nov 30 10:55:55 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:55:55 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:55:55 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:55:55 user nova-compute[75020]:       <entry name="serial">829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</entry>
Nov 30 10:55:55 user nova-compute[75020]:       <entry name="uuid">829d8ebf-f5d9-4c51-80d1-fb6c40b1a699</entry>
Nov 30 10:55:55 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:55:55 user nova-compute[75020]:     </system>
Nov 30 10:55:55 user nova-compute[75020]:   </sysinfo>
Nov 30 10:55:55 user nova-compute[75020]:   <os>
Nov 30 10:55:55 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:55:55 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:55:55 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:55:55 user nova-compute[75020]:   </os>
Nov 30 10:55:55 user nova-compute[75020]:   <features>
Nov 30 10:55:55 user nova-compute[75020]:     <acpi/>
Nov 30 10:55:55 user nova-compute[75020]:     <apic/>
Nov 30 10:55:55 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:55:55 user nova-compute[75020]:   </features>
Nov 30 10:55:55 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:55:55 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:55:55 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:55:55 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:55:55 user nova-compute[75020]:   </clock>
Nov 30 10:55:55 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:55:55 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:55:55 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:55:55 user nova-compute[75020]:   </cpu>
Nov 30 10:55:55 user nova-compute[75020]:   <devices>
Nov 30 10:55:55 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:55:55 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:55:55 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk"/>
Nov 30 10:55:55 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:55:55 user nova-compute[75020]:     </disk>
Nov 30 10:55:55 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:55:55 user nova-compute[75020]:       <mac address="fa:16:3e:54:c0:d7"/>
Nov 30 10:55:55 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:55:55 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:55:55 user nova-compute[75020]:       <target dev="tapd3370635-c4"/>
Nov 30 10:55:55 user nova-compute[75020]:     </interface>
Nov 30 10:55:55 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:55:55 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/console.log" append="off"/>
Nov 30 10:55:55 user nova-compute[75020]:     </serial>
Nov 30 10:55:55 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:55:55 user nova-compute[75020]:     <video>
Nov 30 10:55:55 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:55:55 user nova-compute[75020]:     </video>
Nov 30 10:55:55 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:55:55 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:55:55 user nova-compute[75020]:     </rng>
Nov 30 10:55:55 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:55:55 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:55:55 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:55:55 user nova-compute[75020]:     </memballoon>
Nov 30 10:55:55 user nova-compute[75020]:   </devices>
Nov 30 10:55:55 user nova-compute[75020]: </domain>
Nov 30 10:55:55 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'trusted_certs' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.195s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:55:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Cannot resize image /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'migration_context' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG nova.objects.base [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Object Instance<829d8ebf-f5d9-4c51-80d1-fb6c40b1a699> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG os_vif [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1f96adc-4f30-551c-89e9-e72083986872', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3370635-c4, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3370635-c4, col_values=(('qos', UUID('2050c718-9e4f-4aaf-ae51-9a65c6a64489')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3370635-c4, col_values=(('external_ids', {'iface-id': 'd3370635-c4d4-4dc7-8a3c-a3dd2756dff0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:c0:d7', 'vm-uuid': '829d8ebf-f5d9-4c51-80d1-fb6c40b1a699'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:56 user nova-compute[75020]: INFO os_vif [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4')
Nov 30 10:55:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-ed4be150-0962-4d22-ba8a-d2a9aad6db4f req-19dd3607-3601-4135-878a-857942804e37 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ed4be150-0962-4d22-ba8a-d2a9aad6db4f req-19dd3607-3601-4135-878a-857942804e37 service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ed4be150-0962-4d22-ba8a-d2a9aad6db4f req-19dd3607-3601-4135-878a-857942804e37 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ed4be150-0962-4d22-ba8a-d2a9aad6db4f req-19dd3607-3601-4135-878a-857942804e37 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-ed4be150-0962-4d22-ba8a-d2a9aad6db4f req-19dd3607-3601-4135-878a-857942804e37 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:57 user nova-compute[75020]: WARNING nova.compute.manager [req-ed4be150-0962-4d22-ba8a-d2a9aad6db4f req-19dd3607-3601-4135-878a-857942804e37 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state stopped and task_state powering-on.
Nov 30 10:55:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:55:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:55:59 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance rebooted successfully.
Nov 30 10:55:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-15f3fe1a-b603-4b88-a255-bc25ac7e76b7 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:55:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-df26400a-bd9c-4cde-8b1d-e6b4ceadecd3 req-449a0773-95c6-4317-a864-b292e0cf8a44 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:55:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df26400a-bd9c-4cde-8b1d-e6b4ceadecd3 req-449a0773-95c6-4317-a864-b292e0cf8a44 service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:55:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df26400a-bd9c-4cde-8b1d-e6b4ceadecd3 req-449a0773-95c6-4317-a864-b292e0cf8a44 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:55:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df26400a-bd9c-4cde-8b1d-e6b4ceadecd3 req-449a0773-95c6-4317-a864-b292e0cf8a44 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:55:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-df26400a-bd9c-4cde-8b1d-e6b4ceadecd3 req-449a0773-95c6-4317-a864-b292e0cf8a44 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:55:59 user nova-compute[75020]: WARNING nova.compute.manager [req-df26400a-bd9c-4cde-8b1d-e6b4ceadecd3 req-449a0773-95c6-4317-a864-b292e0cf8a44 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state active and task_state None.
Nov 30 10:56:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:56:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:56:00 user nova-compute[75020]: INFO nova.compute.claims [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Claim successful on node user
Nov 30 10:56:00 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:56:00 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:56:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:56:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:56:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG nova.policy [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f7cebdc6c934eaa97be8559abb908c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d999c2680894b4da64f0225c6bcdd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:56:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Creating image(s)
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "/opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "/opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "/opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.227s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk 1073741824" returned: 0 in 0.052s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.201s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:01 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Successfully created port: 267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Cannot resize image /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Ensure instance console log exists: /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Successfully updated port: 267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquired lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-f6d7528d-e2a8-448e-acc5-ec86f6d546ac req-62001a80-ff2d-46fc-8074-a0765982e04a service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-changed-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-f6d7528d-e2a8-448e-acc5-ec86f6d546ac req-62001a80-ff2d-46fc-8074-a0765982e04a service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Refreshing instance network info cache due to event network-changed-267a3846-2deb-4b5f-9dd9-5475b91be177. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f6d7528d-e2a8-448e-acc5-ec86f6d546ac req-62001a80-ff2d-46fc-8074-a0765982e04a service nova] Acquiring lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:56:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updating instance_info_cache with network_info: [{"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Releasing lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Instance network_info: |[{"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f6d7528d-e2a8-448e-acc5-ec86f6d546ac req-62001a80-ff2d-46fc-8074-a0765982e04a service nova] Acquired lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-f6d7528d-e2a8-448e-acc5-ec86f6d546ac req-62001a80-ff2d-46fc-8074-a0765982e04a service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Refreshing network info cache for port 267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Start _get_guest_xml network_info=[{"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:56:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1702229472',display_name='tempest-TestStampPattern-server-1702229472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1702229472',id=23,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8UuvcChSK6YskalIYpxvBcattqsFAEkXGidi6+8eqZCgj0JoQFKkJY54GUIo9V7Y2I7TNjEyC4R61MG4WaGSwKn4DJq095MqcrSgDLeoxMdOBD3ZIwKqXIZYjQCzQP2A==',key_name='tempest-TestStampPattern-1231142888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d999c2680894b4da64f0225c6bcdd21',ramdisk_id='',reservation_id='r-ww17nxyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-978441576',owner_user_name='tempest-TestStampPattern-978441576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:56:01Z,user_data=None,user_id='4f7cebdc6c934eaa97be8559abb908c3',uuid=875f4516-89d8-432e-aaee-840162613ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converting VIF {"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=267a3846-2deb-4b5f-9dd9-5475b91be177,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267a3846-2d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'pci_devices' on Instance uuid 875f4516-89d8-432e-aaee-840162613ba1 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:56:03 user nova-compute[75020]:   <uuid>875f4516-89d8-432e-aaee-840162613ba1</uuid>
Nov 30 10:56:03 user nova-compute[75020]:   <name>instance-00000017</name>
Nov 30 10:56:03 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:56:03 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:56:03 user nova-compute[75020]:   <metadata>
Nov 30 10:56:03 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:56:03 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:56:03 user nova-compute[75020]:       <nova:name>tempest-TestStampPattern-server-1702229472</nova:name>
Nov 30 10:56:03 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:56:03</nova:creationTime>
Nov 30 10:56:03 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:56:03 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:56:03 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:56:03 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:56:03 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:56:03 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:56:03 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:56:03 user nova-compute[75020]:       <nova:owner>
Nov 30 10:56:03 user nova-compute[75020]:         <nova:user uuid="4f7cebdc6c934eaa97be8559abb908c3">tempest-TestStampPattern-978441576-project-member</nova:user>
Nov 30 10:56:03 user nova-compute[75020]:         <nova:project uuid="0d999c2680894b4da64f0225c6bcdd21">tempest-TestStampPattern-978441576</nova:project>
Nov 30 10:56:03 user nova-compute[75020]:       </nova:owner>
Nov 30 10:56:03 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:56:03 user nova-compute[75020]:       <nova:ports>
Nov 30 10:56:03 user nova-compute[75020]:         <nova:port uuid="267a3846-2deb-4b5f-9dd9-5475b91be177">
Nov 30 10:56:03 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 10:56:03 user nova-compute[75020]:         </nova:port>
Nov 30 10:56:03 user nova-compute[75020]:       </nova:ports>
Nov 30 10:56:03 user nova-compute[75020]:     </nova:instance>
Nov 30 10:56:03 user nova-compute[75020]:   </metadata>
Nov 30 10:56:03 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:56:03 user nova-compute[75020]:     <system>
Nov 30 10:56:03 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:56:03 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:56:03 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:56:03 user nova-compute[75020]:       <entry name="serial">875f4516-89d8-432e-aaee-840162613ba1</entry>
Nov 30 10:56:03 user nova-compute[75020]:       <entry name="uuid">875f4516-89d8-432e-aaee-840162613ba1</entry>
Nov 30 10:56:03 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:56:03 user nova-compute[75020]:     </system>
Nov 30 10:56:03 user nova-compute[75020]:   </sysinfo>
Nov 30 10:56:03 user nova-compute[75020]:   <os>
Nov 30 10:56:03 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:56:03 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:56:03 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:56:03 user nova-compute[75020]:   </os>
Nov 30 10:56:03 user nova-compute[75020]:   <features>
Nov 30 10:56:03 user nova-compute[75020]:     <acpi/>
Nov 30 10:56:03 user nova-compute[75020]:     <apic/>
Nov 30 10:56:03 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:56:03 user nova-compute[75020]:   </features>
Nov 30 10:56:03 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:56:03 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:56:03 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:56:03 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:56:03 user nova-compute[75020]:   </clock>
Nov 30 10:56:03 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:56:03 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:56:03 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:56:03 user nova-compute[75020]:   </cpu>
Nov 30 10:56:03 user nova-compute[75020]:   <devices>
Nov 30 10:56:03 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:56:03 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:56:03 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk"/>
Nov 30 10:56:03 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:56:03 user nova-compute[75020]:     </disk>
Nov 30 10:56:03 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:56:03 user nova-compute[75020]:       <mac address="fa:16:3e:60:7d:40"/>
Nov 30 10:56:03 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:56:03 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:56:03 user nova-compute[75020]:       <target dev="tap267a3846-2d"/>
Nov 30 10:56:03 user nova-compute[75020]:     </interface>
Nov 30 10:56:03 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:56:03 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/console.log" append="off"/>
Nov 30 10:56:03 user nova-compute[75020]:     </serial>
Nov 30 10:56:03 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:56:03 user nova-compute[75020]:     <video>
Nov 30 10:56:03 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:56:03 user nova-compute[75020]:     </video>
Nov 30 10:56:03 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:56:03 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:56:03 user nova-compute[75020]:     </rng>
Nov 30 10:56:03 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:56:03 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:56:03 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:56:03 user nova-compute[75020]:     </memballoon>
Nov 30 10:56:03 user nova-compute[75020]:   </devices>
Nov 30 10:56:03 user nova-compute[75020]: </domain>
Nov 30 10:56:03 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1702229472',display_name='tempest-TestStampPattern-server-1702229472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1702229472',id=23,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8UuvcChSK6YskalIYpxvBcattqsFAEkXGidi6+8eqZCgj0JoQFKkJY54GUIo9V7Y2I7TNjEyC4R61MG4WaGSwKn4DJq095MqcrSgDLeoxMdOBD3ZIwKqXIZYjQCzQP2A==',key_name='tempest-TestStampPattern-1231142888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d999c2680894b4da64f0225c6bcdd21',ramdisk_id='',reservation_id='r-ww17nxyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-978441576',owner_user_name='tempest-TestStampPattern-978441576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:56:01Z,user_data=None,user_id='4f7cebdc6c934eaa97be8559abb908c3',uuid=875f4516-89d8-432e-aaee-840162613ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converting VIF {"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=267a3846-2deb-4b5f-9dd9-5475b91be177,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267a3846-2d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG os_vif [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=267a3846-2deb-4b5f-9dd9-5475b91be177,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267a3846-2d') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da9716c0-879d-5953-a535-1fdce435a824', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap267a3846-2d, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap267a3846-2d, col_values=(('qos', UUID('1e7a0820-e223-4b92-b0c3-ac22ffa0b226')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap267a3846-2d, col_values=(('external_ids', {'iface-id': '267a3846-2deb-4b5f-9dd9-5475b91be177', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:7d:40', 'vm-uuid': '875f4516-89d8-432e-aaee-840162613ba1'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:03 user nova-compute[75020]: INFO os_vif [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=267a3846-2deb-4b5f-9dd9-5475b91be177,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267a3846-2d')
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No VIF found with MAC fa:16:3e:60:7d:40, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:56:04 user nova-compute[75020]: DEBUG nova.network.neutron [req-f6d7528d-e2a8-448e-acc5-ec86f6d546ac req-62001a80-ff2d-46fc-8074-a0765982e04a service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updated VIF entry in instance network info cache for port 267a3846-2deb-4b5f-9dd9-5475b91be177. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:56:04 user nova-compute[75020]: DEBUG nova.network.neutron [req-f6d7528d-e2a8-448e-acc5-ec86f6d546ac req-62001a80-ff2d-46fc-8074-a0765982e04a service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updating instance_info_cache with network_info: [{"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:56:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f6d7528d-e2a8-448e-acc5-ec86f6d546ac req-62001a80-ff2d-46fc-8074-a0765982e04a service nova] Releasing lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-407a220d-7d76-4242-8918-ba1959df3e09 req-003fbc13-4663-4eb0-8f13-b9002d0fda1e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-407a220d-7d76-4242-8918-ba1959df3e09 req-003fbc13-4663-4eb0-8f13-b9002d0fda1e service nova] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-407a220d-7d76-4242-8918-ba1959df3e09 req-003fbc13-4663-4eb0-8f13-b9002d0fda1e service nova] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-407a220d-7d76-4242-8918-ba1959df3e09 req-003fbc13-4663-4eb0-8f13-b9002d0fda1e service nova] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG nova.compute.manager [req-407a220d-7d76-4242-8918-ba1959df3e09 req-003fbc13-4663-4eb0-8f13-b9002d0fda1e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] No waiting events found dispatching network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:05 user nova-compute[75020]: WARNING nova.compute.manager [req-407a220d-7d76-4242-8918-ba1959df3e09 req-003fbc13-4663-4eb0-8f13-b9002d0fda1e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received unexpected event network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 for instance with vm_state building and task_state spawning.
Nov 30 10:56:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:56:07 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Instance spawned successfully.
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-80179b46-d451-458d-aadb-88e3529d4cc6 req-dc090cb6-f0a8-4640-b132-bcfa91d18263 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-80179b46-d451-458d-aadb-88e3529d4cc6 req-dc090cb6-f0a8-4640-b132-bcfa91d18263 service nova] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-80179b46-d451-458d-aadb-88e3529d4cc6 req-dc090cb6-f0a8-4640-b132-bcfa91d18263 service nova] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-80179b46-d451-458d-aadb-88e3529d4cc6 req-dc090cb6-f0a8-4640-b132-bcfa91d18263 service nova] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-80179b46-d451-458d-aadb-88e3529d4cc6 req-dc090cb6-f0a8-4640-b132-bcfa91d18263 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] No waiting events found dispatching network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:07 user nova-compute[75020]: WARNING nova.compute.manager [req-80179b46-d451-458d-aadb-88e3529d4cc6 req-dc090cb6-f0a8-4640-b132-bcfa91d18263 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received unexpected event network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 for instance with vm_state building and task_state spawning.
Nov 30 10:56:07 user nova-compute[75020]: INFO nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 30 10:56:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:56:07 user nova-compute[75020]: INFO nova.compute.manager [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Took 7.17 seconds to build instance.
Nov 30 10:56:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f669e409-df98-4bc0-86df-3b3a293378cf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.279s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:09 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 is timed out.
Nov 30 10:56:09 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully detached device vdb from instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 from the live domain config.
Nov 30 10:56:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnjugBaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:56:09 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e073afd7-f376-45c3-aa85-62cdd347edd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:56:09 user nova-compute[75020]: No targets found.
Nov 30 10:56:09 user nova-compute[75020]: iSNS:
Nov 30 10:56:09 user nova-compute[75020]: No targets found.
Nov 30 10:56:09 user nova-compute[75020]: STATIC:
Nov 30 10:56:09 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:56:09 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:56:09 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:56:09 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304
Nov 30 10:56:09 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:56:09 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:56:09 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:56:09 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:56:09 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:56:09 user nova-compute[75020]: FIRMWARE:
Nov 30 10:56:09 user nova-compute[75020]: No targets found.
Nov 30 10:56:09 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:56:09 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:56:09 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[08093298-8d37-4174-bd01-619be69ad220]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2280459-ecd1-4762-85fc-6aba3910eeb4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:09 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:09 user nova-compute[75020]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 (non-flash)
Nov 30 10:56:09 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:09 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:09 user nova-compute[75020]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 (non-flash)
Nov 30 10:56:09 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad8860ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed5d90-fa29-4acd-b6ec-d040069b6b47]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d932ffc5-c035-4558-bf2f-32fd80c3930d]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9630843-e9b6-48dd-8349-3cba21de0ab6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[22de94ec-4a77-4828-a648-25fc842908a5]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81bd462-1eac-43af-95a7-344f6b3e8c65]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d075a6-6a0c-4f09-aa77-49cd227410cd]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304, portal: 172.16.0.220,3260]
Nov 30 10:56:09 user nova-compute[75020]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304, portal: 172.16.0.220,3260] successful.
Nov 30 10:56:09 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:572d5d9e-8a7b-4e8f-9e0e-75c7d38d6304 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9e40bb-64eb-42c8-ab86-84957e3146fa]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] <== disconnect_volume: return (353ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:56:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:56:10 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'flavor' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d77febb1-2143-4189-8516-15ffdb4d7a08 tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.824s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'flavor' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:14 user nova-compute[75020]: INFO nova.compute.manager [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Attaching volume 17ca01e2-09ad-4a33-9d6c-412dc3748426 to /dev/vdb
Nov 30 10:56:14 user nova-compute[75020]: DEBUG os_brick.utils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d03f43-cf44-4537-b29a-78b3dd197332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[520be081-7d69-44d4-8b39-b9e3d4eeda8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414cf4c-a89b-4ccc-99b6-9a307f481469]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29028a5-23d2-4fae-95fe-26e605865239]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:56:14 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:56:14 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d31895a-0a0b-496a-885a-7ecb9f7e8019]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG os_brick.utils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:56:14 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating existing volume attachment record: 8137c44b-480a-452d-ac6f-ef828792abcd {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:56:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:56:19 user nova-compute[75020]: INFO nova.compute.claims [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Claim successful on node user
Nov 30 10:56:19 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:56:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:56:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:56:19 user nova-compute[75020]: DEBUG nova.policy [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a93ae25dec664c44ba88b0f15f6a239e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02acda28c914dcdaa8afa65411b8055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:56:20 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Creating image(s)
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "/opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "/opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "/opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.233s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.232s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk 1073741824" returned: 0 in 0.059s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Successfully created port: 0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Cannot resize image /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Ensure instance console log exists: /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Successfully updated port: 0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "refresh_cache-df6c4dec-55bd-4b90-acd4-391e4c17d147" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquired lock "refresh_cache-df6c4dec-55bd-4b90-acd4-391e4c17d147" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-29d48dd0-646e-4d1c-ae2a-c1b9f30132df req-3f8231e7-21f9-41f7-9867-fc3ba8b77017 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-changed-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-29d48dd0-646e-4d1c-ae2a-c1b9f30132df req-3f8231e7-21f9-41f7-9867-fc3ba8b77017 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Refreshing instance network info cache due to event network-changed-0ed92ee1-069a-4881-8877-b0a79c610425. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-29d48dd0-646e-4d1c-ae2a-c1b9f30132df req-3f8231e7-21f9-41f7-9867-fc3ba8b77017 service nova] Acquiring lock "refresh_cache-df6c4dec-55bd-4b90-acd4-391e4c17d147" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Updating instance_info_cache with network_info: [{"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Releasing lock "refresh_cache-df6c4dec-55bd-4b90-acd4-391e4c17d147" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Instance network_info: |[{"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-29d48dd0-646e-4d1c-ae2a-c1b9f30132df req-3f8231e7-21f9-41f7-9867-fc3ba8b77017 service nova] Acquired lock "refresh_cache-df6c4dec-55bd-4b90-acd4-391e4c17d147" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.neutron [req-29d48dd0-646e-4d1c-ae2a-c1b9f30132df req-3f8231e7-21f9-41f7-9867-fc3ba8b77017 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Refreshing network info cache for port 0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Start _get_guest_xml network_info=[{"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:56:21 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:21 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-882959482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-882959482',id=24,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-qj9v1uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:56:20Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=df6c4dec-55bd-4b90-acd4-391e4c17d147,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=0ed92ee1-069a-4881-8877-b0a79c610425,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed92ee1-06') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'pci_devices' on Instance uuid df6c4dec-55bd-4b90-acd4-391e4c17d147 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:56:21 user nova-compute[75020]:   <uuid>df6c4dec-55bd-4b90-acd4-391e4c17d147</uuid>
Nov 30 10:56:21 user nova-compute[75020]:   <name>instance-00000018</name>
Nov 30 10:56:21 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:56:21 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:56:21 user nova-compute[75020]:   <metadata>
Nov 30 10:56:21 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:56:21 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:56:21 user nova-compute[75020]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-882959482</nova:name>
Nov 30 10:56:21 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:56:21</nova:creationTime>
Nov 30 10:56:21 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:56:21 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:56:21 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:56:21 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:56:21 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:56:21 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:56:21 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:56:21 user nova-compute[75020]:       <nova:owner>
Nov 30 10:56:21 user nova-compute[75020]:         <nova:user uuid="a93ae25dec664c44ba88b0f15f6a239e">tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member</nova:user>
Nov 30 10:56:21 user nova-compute[75020]:         <nova:project uuid="e02acda28c914dcdaa8afa65411b8055">tempest-ServerBootFromVolumeStableRescueTest-548019548</nova:project>
Nov 30 10:56:21 user nova-compute[75020]:       </nova:owner>
Nov 30 10:56:21 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:56:21 user nova-compute[75020]:       <nova:ports>
Nov 30 10:56:21 user nova-compute[75020]:         <nova:port uuid="0ed92ee1-069a-4881-8877-b0a79c610425">
Nov 30 10:56:21 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 10:56:21 user nova-compute[75020]:         </nova:port>
Nov 30 10:56:21 user nova-compute[75020]:       </nova:ports>
Nov 30 10:56:21 user nova-compute[75020]:     </nova:instance>
Nov 30 10:56:21 user nova-compute[75020]:   </metadata>
Nov 30 10:56:21 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:56:21 user nova-compute[75020]:     <system>
Nov 30 10:56:21 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:56:21 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:56:21 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:56:21 user nova-compute[75020]:       <entry name="serial">df6c4dec-55bd-4b90-acd4-391e4c17d147</entry>
Nov 30 10:56:21 user nova-compute[75020]:       <entry name="uuid">df6c4dec-55bd-4b90-acd4-391e4c17d147</entry>
Nov 30 10:56:21 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:56:21 user nova-compute[75020]:     </system>
Nov 30 10:56:21 user nova-compute[75020]:   </sysinfo>
Nov 30 10:56:21 user nova-compute[75020]:   <os>
Nov 30 10:56:21 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:56:21 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:56:21 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:56:21 user nova-compute[75020]:   </os>
Nov 30 10:56:21 user nova-compute[75020]:   <features>
Nov 30 10:56:21 user nova-compute[75020]:     <acpi/>
Nov 30 10:56:21 user nova-compute[75020]:     <apic/>
Nov 30 10:56:21 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:56:21 user nova-compute[75020]:   </features>
Nov 30 10:56:21 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:56:21 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:56:21 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:56:21 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:56:21 user nova-compute[75020]:   </clock>
Nov 30 10:56:21 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:56:21 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:56:21 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:56:21 user nova-compute[75020]:   </cpu>
Nov 30 10:56:21 user nova-compute[75020]:   <devices>
Nov 30 10:56:21 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:56:21 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:56:21 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk"/>
Nov 30 10:56:21 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:56:21 user nova-compute[75020]:     </disk>
Nov 30 10:56:21 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:56:21 user nova-compute[75020]:       <mac address="fa:16:3e:88:79:7a"/>
Nov 30 10:56:21 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:56:21 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:56:21 user nova-compute[75020]:       <target dev="tap0ed92ee1-06"/>
Nov 30 10:56:21 user nova-compute[75020]:     </interface>
Nov 30 10:56:21 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:56:21 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/console.log" append="off"/>
Nov 30 10:56:21 user nova-compute[75020]:     </serial>
Nov 30 10:56:21 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:56:21 user nova-compute[75020]:     <video>
Nov 30 10:56:21 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:56:21 user nova-compute[75020]:     </video>
Nov 30 10:56:21 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:56:21 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:56:21 user nova-compute[75020]:     </rng>
Nov 30 10:56:21 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:56:21 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:56:21 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:56:21 user nova-compute[75020]:     </memballoon>
Nov 30 10:56:21 user nova-compute[75020]:   </devices>
Nov 30 10:56:21 user nova-compute[75020]: </domain>
Nov 30 10:56:21 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-882959482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-882959482',id=24,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-qj9v1uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:56:20Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=df6c4dec-55bd-4b90-acd4-391e4c17d147,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=0ed92ee1-069a-4881-8877-b0a79c610425,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed92ee1-06') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG os_vif [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=0ed92ee1-069a-4881-8877-b0a79c610425,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed92ee1-06') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eeac230a-d470-5f7a-a102-a2cd7c6d7e45', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ed92ee1-06, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ed92ee1-06, col_values=(('qos', UUID('5da95904-bbdc-4ee7-bd31-00c2d099a3e5')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ed92ee1-06, col_values=(('external_ids', {'iface-id': '0ed92ee1-069a-4881-8877-b0a79c610425', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:79:7a', 'vm-uuid': 'df6c4dec-55bd-4b90-acd4-391e4c17d147'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:56:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:21 user nova-compute[75020]: INFO os_vif [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=0ed92ee1-069a-4881-8877-b0a79c610425,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed92ee1-06')
Nov 30 10:56:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No VIF found with MAC fa:16:3e:88:79:7a, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:56:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-29d48dd0-646e-4d1c-ae2a-c1b9f30132df req-3f8231e7-21f9-41f7-9867-fc3ba8b77017 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Updated VIF entry in instance network info cache for port 0ed92ee1-069a-4881-8877-b0a79c610425. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:56:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-29d48dd0-646e-4d1c-ae2a-c1b9f30132df req-3f8231e7-21f9-41f7-9867-fc3ba8b77017 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Updating instance_info_cache with network_info: [{"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:56:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-29d48dd0-646e-4d1c-ae2a-c1b9f30132df req-3f8231e7-21f9-41f7-9867-fc3ba8b77017 service nova] Releasing lock "refresh_cache-df6c4dec-55bd-4b90-acd4-391e4c17d147" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf67e43f-a29b-4dd3-b123-1d538478636b req-c6c6d19d-22c0-432c-901e-7239e3488ef6 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf67e43f-a29b-4dd3-b123-1d538478636b req-c6c6d19d-22c0-432c-901e-7239e3488ef6 service nova] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf67e43f-a29b-4dd3-b123-1d538478636b req-c6c6d19d-22c0-432c-901e-7239e3488ef6 service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf67e43f-a29b-4dd3-b123-1d538478636b req-c6c6d19d-22c0-432c-901e-7239e3488ef6 service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf67e43f-a29b-4dd3-b123-1d538478636b req-c6c6d19d-22c0-432c-901e-7239e3488ef6 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] No waiting events found dispatching network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:23 user nova-compute[75020]: WARNING nova.compute.manager [req-cf67e43f-a29b-4dd3-b123-1d538478636b req-c6c6d19d-22c0-432c-901e-7239e3488ef6 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received unexpected event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 for instance with vm_state building and task_state spawning.
Nov 30 10:56:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvrVBXTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:56:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:56:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:56:24 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5826049-c0dc-401a-af09-1d39cb90bd33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:56:24 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9daae-c4a4-474a-88da-1d3cbe311861]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426] added
Nov 30 10:56:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df02956-1b0c-4a71-80a7-4908d5c43149]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d31a184-798f-4cb0-9c83-c3b6148efcf6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvrVBXTH {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvrVBXTH" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c996f-ebe0-462a-9421-2fc63738c2b6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hvrVBXTH'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2a5b64-4ec1-4193-b962-a850b96a47a6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8d6594-d52b-4fca-8377-3a4c58b3758c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa44ce7a-47ad-499f-ab19-bdedf37bc0aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426, portal: 172.16.0.220,3260]
Nov 30 10:56:25 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426, portal: 172.16.0.220,3260] successful.
Nov 30 10:56:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d801f7-dc04-4155-9b91-73e8e3bd7fc9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34255cc-ef56-427f-8cff-081a27b1383d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:56:25 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8001604-0ce8-4229-b3c5-0dbc6f78bda3]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvrVBXTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-35b02963-86f4-4f29-a9e6-ef1b0b1ee457 req-42326cab-a6b1-4d46-9390-0584e5cc9fd0 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35b02963-86f4-4f29-a9e6-ef1b0b1ee457 req-42326cab-a6b1-4d46-9390-0584e5cc9fd0 service nova] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35b02963-86f4-4f29-a9e6-ef1b0b1ee457 req-42326cab-a6b1-4d46-9390-0584e5cc9fd0 service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-35b02963-86f4-4f29-a9e6-ef1b0b1ee457 req-42326cab-a6b1-4d46-9390-0584e5cc9fd0 service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-35b02963-86f4-4f29-a9e6-ef1b0b1ee457 req-42326cab-a6b1-4d46-9390-0584e5cc9fd0 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] No waiting events found dispatching network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:25 user nova-compute[75020]: WARNING nova.compute.manager [req-35b02963-86f4-4f29-a9e6-ef1b0b1ee457 req-42326cab-a6b1-4d46-9390-0584e5cc9fd0 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received unexpected event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 for instance with vm_state building and task_state spawning.
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:56:25 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Instance spawned successfully.
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:56:25 user nova-compute[75020]: INFO nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 30 10:56:25 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:56:26 user nova-compute[75020]: INFO nova.compute.manager [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Took 7.01 seconds to build instance.
Nov 30 10:56:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f8b364fd-fffc-4640-b492-da96ec224da4 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.154s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23438396133373836', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438396133373836', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'flavor' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:56:26 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:56:26 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:56:26 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:56:26 user nova-compute[75020]:   <serial>17ca01e2-09ad-4a33-9d6c-412dc3748426</serial>
Nov 30 10:56:26 user nova-compute[75020]: </disk>
Nov 30 10:56:26 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No VIF found with MAC fa:16:3e:8c:1b:db, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e39ea564-005a-4548-a34b-d8d05199956c tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.196s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:28 user nova-compute[75020]: INFO nova.compute.manager [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Rescuing
Nov 30 10:56:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:56:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquired lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:56:28 user nova-compute[75020]: DEBUG nova.network.neutron [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:56:28 user nova-compute[75020]: DEBUG nova.network.neutron [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating instance_info_cache with network_info: [{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:56:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Releasing lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdf3b23d-d161-420c-b84a-1bd0f3d98a89 req-16678442-4b6a-43a0-ba0b-623d19e1f2ca service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdf3b23d-d161-420c-b84a-1bd0f3d98a89 req-16678442-4b6a-43a0-ba0b-623d19e1f2ca service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdf3b23d-d161-420c-b84a-1bd0f3d98a89 req-16678442-4b6a-43a0-ba0b-623d19e1f2ca service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdf3b23d-d161-420c-b84a-1bd0f3d98a89 req-16678442-4b6a-43a0-ba0b-623d19e1f2ca service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdf3b23d-d161-420c-b84a-1bd0f3d98a89 req-16678442-4b6a-43a0-ba0b-623d19e1f2ca service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:29 user nova-compute[75020]: WARNING nova.compute.manager [req-fdf3b23d-d161-420c-b84a-1bd0f3d98a89 req-16678442-4b6a-43a0-ba0b-623d19e1f2ca service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state active and task_state rescuing.
Nov 30 10:56:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance destroyed successfully.
Nov 30 10:56:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Attempting a stable device rescue
Nov 30 10:56:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75020) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance directory exists: not creating {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 10:56:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Creating image(s)
Nov 30 10:56:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'trusted_certs' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "b49a00f285e2e14c48cf3279aa19732bce40945d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "b49a00f285e2e14c48cf3279aa19732bce40945d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:31 user nova-compute[75020]: WARNING nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state active and task_state rescuing.
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:31 user nova-compute[75020]: WARNING nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state active and task_state rescuing.
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:31 user nova-compute[75020]: WARNING nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state active and task_state rescuing.
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:31 user nova-compute[75020]: WARNING nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state active and task_state rescuing.
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:31 user nova-compute[75020]: WARNING nova.compute.manager [req-07b7113d-10aa-4edd-b2e0-c8ed9b00d2d6 req-b9d4c9a9-3b7b-436e-8669-8d0017b5d2be service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state active and task_state rescuing.
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.virt.images [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] c51f1e2f-3124-4459-ab01-1de16caa21ee was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:56:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d.part /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d.part /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d.converted" returned: 0 in 0.659s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "b49a00f285e2e14c48cf3279aa19732bce40945d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.435s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "b49a00f285e2e14c48cf3279aa19732bce40945d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "b49a00f285e2e14c48cf3279aa19732bce40945d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d --force-share --output=json" returned: 0 in 0.203s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d,backing_fmt=raw /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d,backing_fmt=raw /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue" returned: 0 in 0.057s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "b49a00f285e2e14c48cf3279aa19732bce40945d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'migration_context' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.objects.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Object Instance<fae5310f-5516-4349-ad31-4df9453171a7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Start _get_guest_xml network_info=[{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "vif_mac": "fa:16:3e:8c:1b:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c51f1e2f-3124-4459-ab01-1de16caa21ee', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '8137c44b-480a-452d-ac6f-ef828792abcd', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvrVBXTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fae5310f-5516-4349-ad31-4df9453171a7', 'attached_at': '', 'detached_at': '', 'volume_id': '17ca01e2-09ad-4a33-9d6c-412dc3748426', 'serial': '17ca01e2-09ad-4a33-9d6c-412dc3748426'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'resources' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.objects.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Object Instance<fae5310f-5516-4349-ad31-4df9453171a7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'numa_topology' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.objects.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Object Instance<fae5310f-5516-4349-ad31-4df9453171a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'vcpu_model' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.objects.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Object Instance<fae5310f-5516-4349-ad31-4df9453171a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvrVBXTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:56:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:56:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:56:32 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6100503a-1df5-47b3-bd05-1174ea86eca3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hvrVBXTH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 10:56:32 user nova-compute[75020]: node.name = iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426
Nov 30 10:56:32 user nova-compute[75020]: node.tpgt = -1
Nov 30 10:56:32 user nova-compute[75020]: node.startup = automatic
Nov 30 10:56:32 user nova-compute[75020]: node.leading_login = No
Nov 30 10:56:32 user nova-compute[75020]: iface.iscsi_ifacename = default
Nov 30 10:56:32 user nova-compute[75020]: iface.net_ifacename = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.ipaddress = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.prefix_len = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.hwaddress = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.transport_name = tcp
Nov 30 10:56:32 user nova-compute[75020]: iface.initiatorname = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.state = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.vlan_id = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.vlan_priority = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.vlan_state = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.iface_num = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.mtu = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.port = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.bootproto = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.subnet_mask = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.gateway = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.dhcp_alt_client_id = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.dhcp_dns = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.dhcp_learn_iqn = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.dhcp_vendor_id_state = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.dhcp_vendor_id = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.dhcp_slp_da = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.fragmentation = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.gratuitous_arp = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.incoming_forwarding = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.tos_state = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.tos = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.ttl = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.delayed_ack = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.tcp_nagle = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.tcp_wsf_state = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.tcp_wsf = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.tcp_timer_scale = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.tcp_timestamp = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.redirect = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.def_task_mgmt_timeout = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.header_digest = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.data_digest = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.immediate_data = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.initial_r2t = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.data_seq_inorder = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.data_pdu_inorder = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.erl = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.max_receive_data_len = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.first_burst_len = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.max_outstanding_r2t = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.max_burst_len = 0
Nov 30 10:56:32 user nova-compute[75020]: iface.chap_auth = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.bidi_chap = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.strict_login_compliance = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.discovery_auth = <empty>
Nov 30 10:56:32 user nova-compute[75020]: iface.discovery_logout = <empty>
Nov 30 10:56:32 user nova-compute[75020]: node.discovery_address = <empty>
Nov 30 10:56:32 user nova-compute[75020]: node.discovery_port = 0
Nov 30 10:56:32 user nova-compute[75020]: node.discovery_type = static
Nov 30 10:56:32 user nova-compute[75020]: node.session.initial_cmdsn = 0
Nov 30 10:56:32 user nova-compute[75020]: node.session.initial_login_retry_max = 8
Nov 30 10:56:32 user nova-compute[75020]: node.session.xmit_thread_priority = -20
Nov 30 10:56:32 user nova-compute[75020]: node.session.cmds_max = 128
Nov 30 10:56:32 user nova-compute[75020]: node.session.queue_depth = 32
Nov 30 10:56:32 user nova-compute[75020]: node.session.nr_sessions = 1
Nov 30 10:56:32 user nova-compute[75020]: node.session.auth.authmethod = CHAP
Nov 30 10:56:32 user nova-compute[75020]: node.session.auth.username = hvrVBXTH
Nov 30 10:56:32 user nova-compute[75020]: node.session.auth.password = ***
Nov 30 10:56:32 user nova-compute[75020]: node.session.auth.username_in = <empty>
Nov 30 10:56:32 user nova-compute[75020]: node.session.auth.password_in = <empty>
Nov 30 10:56:32 user nova-compute[75020]: node.session.auth.chap_algs = MD5
Nov 30 10:56:32 user nova-compute[75020]: node.session.timeo.replacement_timeout = 120
Nov 30 10:56:32 user nova-compute[75020]: node.session.err_timeo.abort_timeout = 15
Nov 30 10:56:32 user nova-compute[75020]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 10:56:32 user nova-compute[75020]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 10:56:32 user nova-compute[75020]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.FastAbort = Yes
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.InitialR2T = No
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.ImmediateData = Yes
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.MaxConnections = 1
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 10:56:32 user nova-compute[75020]: node.session.iscsi.ERL = 0
Nov 30 10:56:32 user nova-compute[75020]: node.session.scan = manual
Nov 30 10:56:32 user nova-compute[75020]: node.session.reopen_max = 0
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].address = 172.16.0.220
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].port = 3260
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].startup = manual
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].tcp.window_size = 524288
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].tcp.type_of_service = 0
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].timeo.logout_timeout = 15
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].timeo.login_timeout = 15
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].timeo.auth_timeout = 45
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].iscsi.DataDigest = None
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].iscsi.IFMarker = No
Nov 30 10:56:32 user nova-compute[75020]: node.conn[0].iscsi.OFMarker = No
Nov 30 10:56:32 user nova-compute[75020]: # END RECORD
Nov 30 10:56:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dd9dfc-fa52-4784-a294-744c304cf53f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b0a53-0e6a-45f7-9675-679088c0a2b9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvrVBXTH {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvrVBXTH" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b60cec9-bd9e-454d-9ac5-0c6d709e114f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hvrVBXTH'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce290790-4e1b-43c2-ac4d-547b388dc100]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f6f4ae-5998-4304-a46a-1fe6901d5455]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:32 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:32 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:56:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:32 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:32 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:56:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] HCTL ('34', '0', '0', 0) found on session 25 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:56:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a5c62b-c1e6-4701-b30c-8c33cbbe7ac2]: (4, ('0 0 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Searching for a device in session 25 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvrVBXTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23438396133373836', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438396133373836', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1528753811',display_name='tempest-ServerStableDeviceRescueTest-server-1528753811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1528753811',id=17,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkAChtDxffRIlPGYFGRuJtAVkekQcw1uV8ePrIIuQr5SosrYxX3CAafIjEH3mP8UFojTtie6pHZd29rHhWQHbfV+u8DDejqZQRsBEATIYQ92TlesQyXERYqkULA9v27yQ==',key_name='tempest-keypair-1223282536',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:52:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55004ba1e4574301bb3719f8b844e4b3',ramdisk_id='',reservation_id='r-itm15rol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1531770868',owner_user_name='tempest-ServerStableDeviceRescueTest-1531770868-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:54:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da395ea928bf46038b99ad9a07316e0c',uuid=fae5310f-5516-4349-ad31-4df9453171a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "vif_mac": "fa:16:3e:8c:1b:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Converting VIF {"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "vif_mac": "fa:16:3e:8c:1b:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1b:db,bridge_name='br-int',has_traffic_filtering=True,id=3a7eecf5-e982-408c-a25e-885e6d940868,network=Network(606a02ce-3a02-4189-b153-058024e588a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7eecf5-e9') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'pci_devices' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.objects.base [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Object Instance<fae5310f-5516-4349-ad31-4df9453171a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:56:33 user nova-compute[75020]:   <uuid>fae5310f-5516-4349-ad31-4df9453171a7</uuid>
Nov 30 10:56:33 user nova-compute[75020]:   <name>instance-00000011</name>
Nov 30 10:56:33 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:56:33 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:56:33 user nova-compute[75020]:   <metadata>
Nov 30 10:56:33 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:56:33 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:56:33 user nova-compute[75020]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1528753811</nova:name>
Nov 30 10:56:33 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:56:32</nova:creationTime>
Nov 30 10:56:33 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:56:33 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:56:33 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:56:33 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:56:33 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:56:33 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:56:33 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:56:33 user nova-compute[75020]:       <nova:owner>
Nov 30 10:56:33 user nova-compute[75020]:         <nova:user uuid="da395ea928bf46038b99ad9a07316e0c">tempest-ServerStableDeviceRescueTest-1531770868-project-member</nova:user>
Nov 30 10:56:33 user nova-compute[75020]:         <nova:project uuid="55004ba1e4574301bb3719f8b844e4b3">tempest-ServerStableDeviceRescueTest-1531770868</nova:project>
Nov 30 10:56:33 user nova-compute[75020]:       </nova:owner>
Nov 30 10:56:33 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:56:33 user nova-compute[75020]:       <nova:ports>
Nov 30 10:56:33 user nova-compute[75020]:         <nova:port uuid="3a7eecf5-e982-408c-a25e-885e6d940868">
Nov 30 10:56:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 10:56:33 user nova-compute[75020]:         </nova:port>
Nov 30 10:56:33 user nova-compute[75020]:       </nova:ports>
Nov 30 10:56:33 user nova-compute[75020]:     </nova:instance>
Nov 30 10:56:33 user nova-compute[75020]:   </metadata>
Nov 30 10:56:33 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:56:33 user nova-compute[75020]:     <system>
Nov 30 10:56:33 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:56:33 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:56:33 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:56:33 user nova-compute[75020]:       <entry name="serial">fae5310f-5516-4349-ad31-4df9453171a7</entry>
Nov 30 10:56:33 user nova-compute[75020]:       <entry name="uuid">fae5310f-5516-4349-ad31-4df9453171a7</entry>
Nov 30 10:56:33 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:56:33 user nova-compute[75020]:     </system>
Nov 30 10:56:33 user nova-compute[75020]:   </sysinfo>
Nov 30 10:56:33 user nova-compute[75020]:   <os>
Nov 30 10:56:33 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:56:33 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:56:33 user nova-compute[75020]:   </os>
Nov 30 10:56:33 user nova-compute[75020]:   <features>
Nov 30 10:56:33 user nova-compute[75020]:     <acpi/>
Nov 30 10:56:33 user nova-compute[75020]:     <apic/>
Nov 30 10:56:33 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:56:33 user nova-compute[75020]:   </features>
Nov 30 10:56:33 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:56:33 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:56:33 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:56:33 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:56:33 user nova-compute[75020]:   </clock>
Nov 30 10:56:33 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:56:33 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:56:33 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:56:33 user nova-compute[75020]:   </cpu>
Nov 30 10:56:33 user nova-compute[75020]:   <devices>
Nov 30 10:56:33 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:56:33 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:56:33 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk"/>
Nov 30 10:56:33 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:56:33 user nova-compute[75020]:     </disk>
Nov 30 10:56:33 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:56:33 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:56:33 user nova-compute[75020]:       <source dev="/dev/sdc"/>
Nov 30 10:56:33 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 10:56:33 user nova-compute[75020]:       <serial>17ca01e2-09ad-4a33-9d6c-412dc3748426</serial>
Nov 30 10:56:33 user nova-compute[75020]:     </disk>
Nov 30 10:56:33 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:56:33 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:56:33 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue"/>
Nov 30 10:56:33 user nova-compute[75020]:       <target dev="vdc" bus="virtio"/>
Nov 30 10:56:33 user nova-compute[75020]:       <boot order="1"/>
Nov 30 10:56:33 user nova-compute[75020]:     </disk>
Nov 30 10:56:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:56:33 user nova-compute[75020]:       <mac address="fa:16:3e:8c:1b:db"/>
Nov 30 10:56:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:56:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:56:33 user nova-compute[75020]:       <target dev="tap3a7eecf5-e9"/>
Nov 30 10:56:33 user nova-compute[75020]:     </interface>
Nov 30 10:56:33 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:56:33 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/console.log" append="off"/>
Nov 30 10:56:33 user nova-compute[75020]:     </serial>
Nov 30 10:56:33 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:56:33 user nova-compute[75020]:     <video>
Nov 30 10:56:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:56:33 user nova-compute[75020]:     </video>
Nov 30 10:56:33 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:56:33 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:56:33 user nova-compute[75020]:     </rng>
Nov 30 10:56:33 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:56:33 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:56:33 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:56:33 user nova-compute[75020]:     </memballoon>
Nov 30 10:56:33 user nova-compute[75020]:   </devices>
Nov 30 10:56:33 user nova-compute[75020]: </domain>
Nov 30 10:56:33 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:56:33 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance destroyed successfully.
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] No VIF found with MAC fa:16:3e:8c:1b:db, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:56:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-112b4a49-7404-4813-8e3d-015b33a59d1c req-8024d382-7172-4a7f-8441-df83b06662dd service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-112b4a49-7404-4813-8e3d-015b33a59d1c req-8024d382-7172-4a7f-8441-df83b06662dd service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-112b4a49-7404-4813-8e3d-015b33a59d1c req-8024d382-7172-4a7f-8441-df83b06662dd service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-112b4a49-7404-4813-8e3d-015b33a59d1c req-8024d382-7172-4a7f-8441-df83b06662dd service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-112b4a49-7404-4813-8e3d-015b33a59d1c req-8024d382-7172-4a7f-8441-df83b06662dd service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:35 user nova-compute[75020]: WARNING nova.compute.manager [req-112b4a49-7404-4813-8e3d-015b33a59d1c req-8024d382-7172-4a7f-8441-df83b06662dd service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state active and task_state rescuing.
Nov 30 10:56:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:36 user nova-compute[75020]: INFO nova.compute.manager [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Detaching volume 8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:56:36 user nova-compute[75020]: INFO nova.virt.block_device [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Attempting to driver detach volume 8683b106-c46e-48dd-8c38-edc266cd94f9 from mountpoint /dev/vdb
Nov 30 10:56:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Attempting to detach device vdb from instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:56:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:56:36 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:56:36 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:56:36 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:56:36 user nova-compute[75020]:   <serial>8683b106-c46e-48dd-8c38-edc266cd94f9</serial>
Nov 30 10:56:36 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 10:56:36 user nova-compute[75020]: </disk>
Nov 30 10:56:36 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:56:36 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully detached device vdb from instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 from the persistent domain config.
Nov 30 10:56:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:56:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:56:36 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:56:36 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 10:56:36 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:56:36 user nova-compute[75020]:   <serial>8683b106-c46e-48dd-8c38-edc266cd94f9</serial>
Nov 30 10:56:36 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 10:56:36 user nova-compute[75020]: </disk>
Nov 30 10:56:36 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:56:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:56:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-3e0382ee-69c6-429b-b262-d38fd6fffca0 req-b1522677-9eb8-4405-8d06-cd0cbdb254fa service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3e0382ee-69c6-429b-b262-d38fd6fffca0 req-b1522677-9eb8-4405-8d06-cd0cbdb254fa service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3e0382ee-69c6-429b-b262-d38fd6fffca0 req-b1522677-9eb8-4405-8d06-cd0cbdb254fa service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3e0382ee-69c6-429b-b262-d38fd6fffca0 req-b1522677-9eb8-4405-8d06-cd0cbdb254fa service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-3e0382ee-69c6-429b-b262-d38fd6fffca0 req-b1522677-9eb8-4405-8d06-cd0cbdb254fa service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:37 user nova-compute[75020]: WARNING nova.compute.manager [req-3e0382ee-69c6-429b-b262-d38fd6fffca0 req-b1522677-9eb8-4405-8d06-cd0cbdb254fa service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state active and task_state rescuing.
Nov 30 10:56:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-c12c3ca1-9ee2-46b9-bf42-fd6f888a8900 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:56:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:49 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:49 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7191MB free_disk=25.054611206054688GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance fae5310f-5516-4349-ad31-4df9453171a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e35772a3-9a06-4ae7-bf6d-e433fee4dee6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 875f4516-89d8-432e-aaee-840162613ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:56:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:56:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:56:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:56:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updating instance_info_cache with network_info: [{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:56:51 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:56:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:53 user nova-compute[75020]: INFO nova.compute.manager [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Rescuing
Nov 30 10:56:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:56:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquired lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:56:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updating instance_info_cache with network_info: [{"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Releasing lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-743cc509-7d24-4ad8-a4a7-012c183a10e5 req-b2aed3dc-86a3-4d46-9af2-637f315c5025 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-unplugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-743cc509-7d24-4ad8-a4a7-012c183a10e5 req-b2aed3dc-86a3-4d46-9af2-637f315c5025 service nova] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-743cc509-7d24-4ad8-a4a7-012c183a10e5 req-b2aed3dc-86a3-4d46-9af2-637f315c5025 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-743cc509-7d24-4ad8-a4a7-012c183a10e5 req-b2aed3dc-86a3-4d46-9af2-637f315c5025 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-743cc509-7d24-4ad8-a4a7-012c183a10e5 req-b2aed3dc-86a3-4d46-9af2-637f315c5025 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] No waiting events found dispatching network-vif-unplugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:54 user nova-compute[75020]: WARNING nova.compute.manager [req-743cc509-7d24-4ad8-a4a7-012c183a10e5 req-b2aed3dc-86a3-4d46-9af2-637f315c5025 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received unexpected event network-vif-unplugged-b32faceb-68a8-41a0-bb9c-8323823298aa for instance with vm_state active and task_state rescuing.
Nov 30 10:56:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Instance destroyed successfully.
Nov 30 10:56:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Attempting rescue
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75020) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Instance directory exists: not creating {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 10:56:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Creating image(s)
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'trusted_certs' on Instance uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue" returned: 0 in 0.054s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'migration_context' on Instance uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Start _get_guest_xml network_info=[{"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:36:6e:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'resources' on Instance uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'numa_topology' on Instance uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-236943404',display_name='tempest-ServerRescueNegativeTestJSON-server-236943404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-236943404',id=21,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-8q4lqc6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:55:11Z,user_data=None,user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:36:6e:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:36:6e:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=b32faceb-68a8-41a0-bb9c-8323823298aa,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32faceb-68') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'pci_devices' on Instance uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:56:55 user nova-compute[75020]:   <uuid>a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f</uuid>
Nov 30 10:56:55 user nova-compute[75020]:   <name>instance-00000015</name>
Nov 30 10:56:55 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:56:55 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:56:55 user nova-compute[75020]:   <metadata>
Nov 30 10:56:55 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:56:55 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:56:55 user nova-compute[75020]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-236943404</nova:name>
Nov 30 10:56:55 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:56:55</nova:creationTime>
Nov 30 10:56:55 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:56:55 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:56:55 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:56:55 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:56:55 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:56:55 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:56:55 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:56:55 user nova-compute[75020]:       <nova:owner>
Nov 30 10:56:55 user nova-compute[75020]:         <nova:user uuid="2cee10a54cf845a6a328df4e9ea4be85">tempest-ServerRescueNegativeTestJSON-2071093195-project-member</nova:user>
Nov 30 10:56:55 user nova-compute[75020]:         <nova:project uuid="8f16bf7c990e4b7c945642594b58584e">tempest-ServerRescueNegativeTestJSON-2071093195</nova:project>
Nov 30 10:56:55 user nova-compute[75020]:       </nova:owner>
Nov 30 10:56:55 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:56:55 user nova-compute[75020]:       <nova:ports>
Nov 30 10:56:55 user nova-compute[75020]:         <nova:port uuid="b32faceb-68a8-41a0-bb9c-8323823298aa">
Nov 30 10:56:55 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 10:56:55 user nova-compute[75020]:         </nova:port>
Nov 30 10:56:55 user nova-compute[75020]:       </nova:ports>
Nov 30 10:56:55 user nova-compute[75020]:     </nova:instance>
Nov 30 10:56:55 user nova-compute[75020]:   </metadata>
Nov 30 10:56:55 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:56:55 user nova-compute[75020]:     <system>
Nov 30 10:56:55 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:56:55 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:56:55 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:56:55 user nova-compute[75020]:       <entry name="serial">a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f</entry>
Nov 30 10:56:55 user nova-compute[75020]:       <entry name="uuid">a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f</entry>
Nov 30 10:56:55 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:56:55 user nova-compute[75020]:     </system>
Nov 30 10:56:55 user nova-compute[75020]:   </sysinfo>
Nov 30 10:56:55 user nova-compute[75020]:   <os>
Nov 30 10:56:55 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:56:55 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:56:55 user nova-compute[75020]:   </os>
Nov 30 10:56:55 user nova-compute[75020]:   <features>
Nov 30 10:56:55 user nova-compute[75020]:     <acpi/>
Nov 30 10:56:55 user nova-compute[75020]:     <apic/>
Nov 30 10:56:55 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:56:55 user nova-compute[75020]:   </features>
Nov 30 10:56:55 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:56:55 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:56:55 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:56:55 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:56:55 user nova-compute[75020]:   </clock>
Nov 30 10:56:55 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:56:55 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:56:55 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:56:55 user nova-compute[75020]:   </cpu>
Nov 30 10:56:55 user nova-compute[75020]:   <devices>
Nov 30 10:56:55 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:56:55 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:56:55 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue"/>
Nov 30 10:56:55 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:56:55 user nova-compute[75020]:     </disk>
Nov 30 10:56:55 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:56:55 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:56:55 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk"/>
Nov 30 10:56:55 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 10:56:55 user nova-compute[75020]:     </disk>
Nov 30 10:56:55 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:56:55 user nova-compute[75020]:       <mac address="fa:16:3e:36:6e:06"/>
Nov 30 10:56:55 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:56:55 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:56:55 user nova-compute[75020]:       <target dev="tapb32faceb-68"/>
Nov 30 10:56:55 user nova-compute[75020]:     </interface>
Nov 30 10:56:55 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:56:55 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/console.log" append="off"/>
Nov 30 10:56:55 user nova-compute[75020]:     </serial>
Nov 30 10:56:55 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:56:55 user nova-compute[75020]:     <video>
Nov 30 10:56:55 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:56:55 user nova-compute[75020]:     </video>
Nov 30 10:56:55 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:56:55 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:56:55 user nova-compute[75020]:     </rng>
Nov 30 10:56:55 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:56:55 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:56:55 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:56:55 user nova-compute[75020]:     </memballoon>
Nov 30 10:56:55 user nova-compute[75020]:   </devices>
Nov 30 10:56:55 user nova-compute[75020]: </domain>
Nov 30 10:56:55 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:56:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Instance destroyed successfully.
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:56:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No VIF found with MAC fa:16:3e:36:6e:06, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:56:56 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 is timed out.
Nov 30 10:56:56 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully detached device vdb from instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 from the live domain config.
Nov 30 10:56:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsLSuUNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:56:56 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7188121c-6d81-42c2-aef9-ac4e21b7317a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:56:56 user nova-compute[75020]: No targets found.
Nov 30 10:56:56 user nova-compute[75020]: iSNS:
Nov 30 10:56:56 user nova-compute[75020]: No targets found.
Nov 30 10:56:56 user nova-compute[75020]: STATIC:
Nov 30 10:56:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9
Nov 30 10:56:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:56:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:56:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426
Nov 30 10:56:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:56:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:56:56 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:56:56 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:56:56 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:56:56 user nova-compute[75020]: FIRMWARE:
Nov 30 10:56:56 user nova-compute[75020]: No targets found.
Nov 30 10:56:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:56:56 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:56:56 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83594c9-92f6-4f60-a4df-a22b8e8bd222]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-4b35c940-c541-4956-9d0d-c506730cf810 req-81d51db6-f560-40e6-b980-5d3c7d2f551e service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4b35c940-c541-4956-9d0d-c506730cf810 req-81d51db6-f560-40e6-b980-5d3c7d2f551e service nova] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4b35c940-c541-4956-9d0d-c506730cf810 req-81d51db6-f560-40e6-b980-5d3c7d2f551e service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4b35c940-c541-4956-9d0d-c506730cf810 req-81d51db6-f560-40e6-b980-5d3c7d2f551e service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-4b35c940-c541-4956-9d0d-c506730cf810 req-81d51db6-f560-40e6-b980-5d3c7d2f551e service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] No waiting events found dispatching network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:56 user nova-compute[75020]: WARNING nova.compute.manager [req-4b35c940-c541-4956-9d0d-c506730cf810 req-81d51db6-f560-40e6-b980-5d3c7d2f551e service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received unexpected event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa for instance with vm_state active and task_state rescuing.
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdb6aca-e883-44ae-8e01-01bbf85614bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:56 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:56 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:56:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:56:56 user nova-compute[75020]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 (non-flash)
Nov 30 10:56:56 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:56:56 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad887d7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5985d71-42bb-408a-a714-249bdb0878a5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c6eb52-5800-427b-946a-8ed580bc8e9b]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c151465-9064-438b-8331-4ef298ef6e80]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[add44cc7-1f6b-4092-9209-7e80d9cf350c]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:56:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4389bc7-f7a9-444e-a7f6-cb6ca0c5ba4f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[de15ce05-1004-4e86-8a2d-fd0dedb8e7ff]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260]
Nov 30 10:56:57 user nova-compute[75020]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9, portal: 172.16.0.220,3260] successful.
Nov 30 10:56:57 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683b106-c46e-48dd-8c38-edc266cd94f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[19622f0f-0d06-4a4c-b350-8d9bfc1b8111]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== disconnect_volume: return (313ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'flavor' on Instance uuid 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ce8034e6-9d40-446e-bf50-b654e3e0640f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.006s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] No waiting events found dispatching network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:58 user nova-compute[75020]: WARNING nova.compute.manager [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received unexpected event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa for instance with vm_state active and task_state rescuing.
Nov 30 10:56:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:56:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] No waiting events found dispatching network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:56:58 user nova-compute[75020]: WARNING nova.compute.manager [req-442f23ef-044d-4e46-8a7e-465b947290d0 req-a5d95483-1a17-47b2-831c-e5d0c4e82e78 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received unexpected event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa for instance with vm_state active and task_state rescuing.
Nov 30 10:56:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0baa323-a152-4448-80f7-f3f91b901d2f tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:57:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-a317a36d-7a41-4686-bd20-7c38b0d7c1cf req-4c230330-d5f6-4ce4-8fea-39d75898a3fb service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-changed-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-a317a36d-7a41-4686-bd20-7c38b0d7c1cf req-4c230330-d5f6-4ce4-8fea-39d75898a3fb service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Refreshing instance network info cache due to event network-changed-aefbdff1-5f9b-4314-9563-07ebbe7a0f48. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:57:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a317a36d-7a41-4686-bd20-7c38b0d7c1cf req-4c230330-d5f6-4ce4-8fea-39d75898a3fb service nova] Acquiring lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:57:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a317a36d-7a41-4686-bd20-7c38b0d7c1cf req-4c230330-d5f6-4ce4-8fea-39d75898a3fb service nova] Acquired lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:57:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-a317a36d-7a41-4686-bd20-7c38b0d7c1cf req-4c230330-d5f6-4ce4-8fea-39d75898a3fb service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Refreshing network info cache for port aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:57:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:07 user nova-compute[75020]: DEBUG nova.network.neutron [req-a317a36d-7a41-4686-bd20-7c38b0d7c1cf req-4c230330-d5f6-4ce4-8fea-39d75898a3fb service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updated VIF entry in instance network info cache for port aefbdff1-5f9b-4314-9563-07ebbe7a0f48. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:57:07 user nova-compute[75020]: DEBUG nova.network.neutron [req-a317a36d-7a41-4686-bd20-7c38b0d7c1cf req-4c230330-d5f6-4ce4-8fea-39d75898a3fb service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating instance_info_cache with network_info: [{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a317a36d-7a41-4686-bd20-7c38b0d7c1cf req-4c230330-d5f6-4ce4-8fea-39d75898a3fb service nova] Releasing lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:57:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:11 user nova-compute[75020]: INFO nova.compute.manager [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Shelving
Nov 30 10:57:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-ccd8d069-b790-4450-b0b6-33932a06228a req-6ec12211-3ca2-47e5-a378-ba901446d969 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-unplugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ccd8d069-b790-4450-b0b6-33932a06228a req-6ec12211-3ca2-47e5-a378-ba901446d969 service nova] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ccd8d069-b790-4450-b0b6-33932a06228a req-6ec12211-3ca2-47e5-a378-ba901446d969 service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ccd8d069-b790-4450-b0b6-33932a06228a req-6ec12211-3ca2-47e5-a378-ba901446d969 service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-ccd8d069-b790-4450-b0b6-33932a06228a req-6ec12211-3ca2-47e5-a378-ba901446d969 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] No waiting events found dispatching network-vif-unplugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:57:11 user nova-compute[75020]: WARNING nova.compute.manager [req-ccd8d069-b790-4450-b0b6-33932a06228a req-6ec12211-3ca2-47e5-a378-ba901446d969 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received unexpected event network-vif-unplugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 for instance with vm_state active and task_state shelving.
Nov 30 10:57:11 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance destroyed successfully.
Nov 30 10:57:11 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Beginning cold snapshot process
Nov 30 10:57:11 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk /opt/stack/data/nova/instances/snapshots/tmp2uebfqze/a43b7472010148cf89b12df410d10f41 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:11 user nova-compute[75020]: INFO nova.compute.manager [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Terminating instance
Nov 30 10:57:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Instance destroyed successfully.
Nov 30 10:57:12 user nova-compute[75020]: DEBUG nova.objects.instance [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lazy-loading 'resources' on Instance uuid afb7644a-9d91-4a5e-a75c-6d55a0d158d2 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1171281107',display_name='tempest-SnapshotDataIntegrityTests-server-1171281107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1171281107',id=12,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEyicSDWqKhGmXc0rx5ioD5/OQqskzA1wXVFH2Fp7PlRtjEsr9R4Pt+pjzLE4DXCKQmFO5FUYlr7Xx0lXuR6boSWh7aXBhMVABMQWgMgGJYImyE5kb6ElUHIVbbBcmvCQ==',key_name='tempest-keypair-1058685710',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c71024222b364cd287b085eb0b55d90f',ramdisk_id='',reservation_id='r-muc48z2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1856061136',owner_user_name='tempest-SnapshotDataIntegrityTests-1856061136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a009178fb2d84a0bac92dc8e018ef987',uuid=afb7644a-9d91-4a5e-a75c-6d55a0d158d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Converting VIF {"id": "1d101f28-52a3-478f-adc4-58faea79f485", "address": "fa:16:3e:09:53:aa", "network": {"id": "f69563f4-a092-4a0a-b974-38a7f1885026", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1338477925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c71024222b364cd287b085eb0b55d90f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d101f28-52", "ovs_interfaceid": "1d101f28-52a3-478f-adc4-58faea79f485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:53:aa,bridge_name='br-int',has_traffic_filtering=True,id=1d101f28-52a3-478f-adc4-58faea79f485,network=Network(f69563f4-a092-4a0a-b974-38a7f1885026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d101f28-52') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG os_vif [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:53:aa,bridge_name='br-int',has_traffic_filtering=True,id=1d101f28-52a3-478f-adc4-58faea79f485,network=Network(f69563f4-a092-4a0a-b974-38a7f1885026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d101f28-52') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d101f28-52, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk /opt/stack/data/nova/instances/snapshots/tmp2uebfqze/a43b7472010148cf89b12df410d10f41" returned: 0 in 1.045s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f839a71-0c9c-4f22-83ed-45c2e9b948c9) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:57:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Snapshot extracted, beginning image upload
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:12 user nova-compute[75020]: INFO os_vif [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:53:aa,bridge_name='br-int',has_traffic_filtering=True,id=1d101f28-52a3-478f-adc4-58faea79f485,network=Network(f69563f4-a092-4a0a-b974-38a7f1885026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d101f28-52')
Nov 30 10:57:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Deleting instance files /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2_del
Nov 30 10:57:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Deletion of /opt/stack/data/nova/instances/afb7644a-9d91-4a5e-a75c-6d55a0d158d2_del complete
Nov 30 10:57:13 user nova-compute[75020]: INFO nova.compute.manager [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] No waiting events found dispatching network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:57:13 user nova-compute[75020]: WARNING nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received unexpected event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received event network-vif-unplugged-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] No waiting events found dispatching network-vif-unplugged-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received event network-vif-unplugged-1d101f28-52a3-478f-adc4-58faea79f485 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received event network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Acquiring lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] No waiting events found dispatching network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:57:13 user nova-compute[75020]: WARNING nova.compute.manager [req-f013cd10-646b-45de-b03b-afb9865e59ff req-80301f69-1ab5-440e-a188-2089b00a1c41 service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received unexpected event network-vif-plugged-1d101f28-52a3-478f-adc4-58faea79f485 for instance with vm_state active and task_state deleting.
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-30a4af8c-55a7-40a7-8b7d-a9e414ea975d req-1800d919-5e91-4bb8-8b07-a7372883d3dc service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Received event network-vif-deleted-1d101f28-52a3-478f-adc4-58faea79f485 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:13 user nova-compute[75020]: INFO nova.compute.manager [req-30a4af8c-55a7-40a7-8b7d-a9e414ea975d req-1800d919-5e91-4bb8-8b07-a7372883d3dc service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Neutron deleted interface 1d101f28-52a3-478f-adc4-58faea79f485; detaching it from the instance and deleting it from the info cache
Nov 30 10:57:13 user nova-compute[75020]: DEBUG nova.network.neutron [req-30a4af8c-55a7-40a7-8b7d-a9e414ea975d req-1800d919-5e91-4bb8-8b07-a7372883d3dc service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:13 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Took 0.94 seconds to deallocate network for instance.
Nov 30 10:57:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-30a4af8c-55a7-40a7-8b7d-a9e414ea975d req-1800d919-5e91-4bb8-8b07-a7372883d3dc service nova] [instance: afb7644a-9d91-4a5e-a75c-6d55a0d158d2] Detach interface failed, port_id=1d101f28-52a3-478f-adc4-58faea79f485, reason: Instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:57:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:14 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:57:14 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:57:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:14 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Deleted allocations for instance afb7644a-9d91-4a5e-a75c-6d55a0d158d2
Nov 30 10:57:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-84243b2b-62d1-4dfc-9f8d-ccd236d1fc0e tempest-SnapshotDataIntegrityTests-1856061136 tempest-SnapshotDataIntegrityTests-1856061136-project-member] Lock "afb7644a-9d91-4a5e-a75c-6d55a0d158d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.832s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Snapshot image upload complete
Nov 30 10:57:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:57:16 user nova-compute[75020]: INFO nova.compute.manager [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Shelve offloading
Nov 30 10:57:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance destroyed successfully.
Nov 30 10:57:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:57:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:57:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquired lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:57:16 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:57:16 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating instance_info_cache with network_info: [{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Releasing lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:57:17 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance destroyed successfully.
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'resources' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109579761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109579761',id=22,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT8W1BX6gMXbYVws9p8tXcoITcXJxTreWPXHMfF5zJS5l6GCKJvuxQNpVsLnhTOSaVNYw7JU0Jf3KoOdgKN5djdJQWy923wwzCaW58MAtWPBGq8zdUGuy8trqZ4QBcsEQ==',key_name='tempest-keypair-1490479026',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-a1bndffv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member',shelved_at='2023-11-30T10:57:16.012532',shelved_host='user',shelved_image_id='e9d179d7-f28f-4ef3-b270-6b032f4a166b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=e35772a3-9a06-4ae7-bf6d-e433fee4dee6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG os_vif [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaefbdff1-5f, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c860a84d-ec5c-4c55-a17e-899c052ff577) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-03656d39-be92-4878-b1d0-fa902f3abf8f req-ae0893e2-67b3-4a3b-aada-54f276080f5e service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-changed-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-03656d39-be92-4878-b1d0-fa902f3abf8f req-ae0893e2-67b3-4a3b-aada-54f276080f5e service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Refreshing instance network info cache due to event network-changed-aefbdff1-5f9b-4314-9563-07ebbe7a0f48. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-03656d39-be92-4878-b1d0-fa902f3abf8f req-ae0893e2-67b3-4a3b-aada-54f276080f5e service nova] Acquiring lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-03656d39-be92-4878-b1d0-fa902f3abf8f req-ae0893e2-67b3-4a3b-aada-54f276080f5e service nova] Acquired lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-03656d39-be92-4878-b1d0-fa902f3abf8f req-ae0893e2-67b3-4a3b-aada-54f276080f5e service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Refreshing network info cache for port aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:17 user nova-compute[75020]: INFO os_vif [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f')
Nov 30 10:57:17 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Deleting instance files /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6_del
Nov 30 10:57:17 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Deletion of /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6_del complete
Nov 30 10:57:17 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Deleted allocations for instance e35772a3-9a06-4ae7-bf6d-e433fee4dee6
Nov 30 10:57:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'numa_topology' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.objects.base [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<e35772a3-9a06-4ae7-bf6d-e433fee4dee6> lazy-loaded attributes: resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-03656d39-be92-4878-b1d0-fa902f3abf8f req-ae0893e2-67b3-4a3b-aada-54f276080f5e service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updated VIF entry in instance network info cache for port aefbdff1-5f9b-4314-9563-07ebbe7a0f48. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-03656d39-be92-4878-b1d0-fa902f3abf8f req-ae0893e2-67b3-4a3b-aada-54f276080f5e service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating instance_info_cache with network_info: [{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-03656d39-be92-4878-b1d0-fa902f3abf8f req-ae0893e2-67b3-4a3b-aada-54f276080f5e service nova] Releasing lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f7f57e3-ed6c-4421-9f48-704bb32deaa5 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.973s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:26 user nova-compute[75020]: INFO nova.compute.manager [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Terminating instance
Nov 30 10:57:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG nova.compute.manager [req-32ec12b5-9474-421b-a8dc-1aaf3c9c2b99 req-1d51f4e6-be74-4919-bae3-dad00ef95e19 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-unplugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-32ec12b5-9474-421b-a8dc-1aaf3c9c2b99 req-1d51f4e6-be74-4919-bae3-dad00ef95e19 service nova] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-32ec12b5-9474-421b-a8dc-1aaf3c9c2b99 req-1d51f4e6-be74-4919-bae3-dad00ef95e19 service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-32ec12b5-9474-421b-a8dc-1aaf3c9c2b99 req-1d51f4e6-be74-4919-bae3-dad00ef95e19 service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG nova.compute.manager [req-32ec12b5-9474-421b-a8dc-1aaf3c9c2b99 req-1d51f4e6-be74-4919-bae3-dad00ef95e19 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] No waiting events found dispatching network-vif-unplugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG nova.compute.manager [req-32ec12b5-9474-421b-a8dc-1aaf3c9c2b99 req-1d51f4e6-be74-4919-bae3-dad00ef95e19 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-unplugged-78557a1a-289d-4be3-b859-f3f8623fd45c for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:27 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Instance destroyed successfully.
Nov 30 10:57:27 user nova-compute[75020]: DEBUG nova.objects.instance [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'resources' on Instance uuid 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1577208617',display_name='tempest-ServerActionsTestOtherA-server-278695233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1577208617',id=16,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3MNl3vXIHlAfMzsSD6x85put1v2rIbFO9K/J0NJAsxh65y9x1lCMG9kdMXXWUSt8sUghYnnEKtixmuW/zp2tDBop3t0gGhOp7QoNP2SrpDfBfgLTTvhtOaN0iqFAnesA==',key_name='tempest-keypair-800322414',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:54:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-7ognsntj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:54:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=5e5dcbe8-47e9-4cf8-861b-84f37c1c6608,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "78557a1a-289d-4be3-b859-f3f8623fd45c", "address": "fa:16:3e:19:a2:5f", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78557a1a-28", "ovs_interfaceid": "78557a1a-289d-4be3-b859-f3f8623fd45c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG os_vif [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78557a1a-28, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbd87e6c-7a7d-41c1-bba9-91e981c85c0e) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:27 user nova-compute[75020]: INFO os_vif [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:a2:5f,bridge_name='br-int',has_traffic_filtering=True,id=78557a1a-289d-4be3-b859-f3f8623fd45c,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78557a1a-28')
Nov 30 10:57:27 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Deleting instance files /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608_del
Nov 30 10:57:27 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Deletion of /opt/stack/data/nova/instances/5e5dcbe8-47e9-4cf8-861b-84f37c1c6608_del complete
Nov 30 10:57:27 user nova-compute[75020]: INFO nova.compute.manager [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 30 10:57:27 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:57:27 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:57:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-02c4af75-3e5f-498f-a510-9bdac6c5889f req-444ddfa5-88a5-4aaa-95eb-97cf2bb15eeb service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-02c4af75-3e5f-498f-a510-9bdac6c5889f req-444ddfa5-88a5-4aaa-95eb-97cf2bb15eeb service nova] Acquiring lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-02c4af75-3e5f-498f-a510-9bdac6c5889f req-444ddfa5-88a5-4aaa-95eb-97cf2bb15eeb service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-02c4af75-3e5f-498f-a510-9bdac6c5889f req-444ddfa5-88a5-4aaa-95eb-97cf2bb15eeb service nova] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-02c4af75-3e5f-498f-a510-9bdac6c5889f req-444ddfa5-88a5-4aaa-95eb-97cf2bb15eeb service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] No waiting events found dispatching network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:57:28 user nova-compute[75020]: WARNING nova.compute.manager [req-02c4af75-3e5f-498f-a510-9bdac6c5889f req-444ddfa5-88a5-4aaa-95eb-97cf2bb15eeb service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received unexpected event network-vif-plugged-78557a1a-289d-4be3-b859-f3f8623fd45c for instance with vm_state active and task_state deleting.
Nov 30 10:57:28 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:28 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Took 1.57 seconds to deallocate network for instance.
Nov 30 10:57:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-81598c76-ca07-4c7f-8fe8-c9c96e799521 req-71f46337-e347-4482-864b-029957d4e2c4 service nova] [instance: 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608] Received event network-vif-deleted-78557a1a-289d-4be3-b859-f3f8623fd45c {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:29 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:57:29 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:57:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:29 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Deleted allocations for instance 5e5dcbe8-47e9-4cf8-861b-84f37c1c6608
Nov 30 10:57:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00572ad3-1f67-4095-b4ee-2ac861573572 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "5e5dcbe8-47e9-4cf8-861b-84f37c1c6608" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.033s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:43 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:45 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:46 user nova-compute[75020]: INFO nova.compute.manager [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Terminating instance
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.compute.manager [req-aedb3789-dbe2-4cbc-83b1-136612e926c7 req-8a9dae34-f267-4dae-95a3-a913ad8e4ec3 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-aedb3789-dbe2-4cbc-83b1-136612e926c7 req-8a9dae34-f267-4dae-95a3-a913ad8e4ec3 service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-aedb3789-dbe2-4cbc-83b1-136612e926c7 req-8a9dae34-f267-4dae-95a3-a913ad8e4ec3 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-aedb3789-dbe2-4cbc-83b1-136612e926c7 req-8a9dae34-f267-4dae-95a3-a913ad8e4ec3 service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.compute.manager [req-aedb3789-dbe2-4cbc-83b1-136612e926c7 req-8a9dae34-f267-4dae-95a3-a913ad8e4ec3 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.compute.manager [req-aedb3789-dbe2-4cbc-83b1-136612e926c7 req-8a9dae34-f267-4dae-95a3-a913ad8e4ec3 service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-unplugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Instance destroyed successfully.
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.objects.instance [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'resources' on Instance uuid 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-885363355',display_name='tempest-AttachVolumeTestJSON-server-885363355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-885363355',id=2,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcU/qrXZI5Q0DzP/+lHt7lgXiEKoWU4RyxzR5NIKB2Q3EuO5cLHMvNfuvU7xjWVQ097smmtEC/FhHF0eNyNhdES8GlEpRhJ3wh3B16NqACCDX/PUeoaiftpdc+fzR1XsA==',key_name='tempest-keypair-1054584604',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-r0fq0kg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:56:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=829d8ebf-f5d9-4c51-80d1-fb6c40b1a699,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "address": "fa:16:3e:54:c0:d7", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3370635-c4", "ovs_interfaceid": "d3370635-c4d4-4dc7-8a3c-a3dd2756dff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG os_vif [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3370635-c4, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2050c718-9e4f-4aaf-ae51-9a65c6a64489) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:46 user nova-compute[75020]: INFO os_vif [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=d3370635-c4d4-4dc7-8a3c-a3dd2756dff0,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3370635-c4')
Nov 30 10:57:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Deleting instance files /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699_del
Nov 30 10:57:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Deletion of /opt/stack/data/nova/instances/829d8ebf-f5d9-4c51-80d1-fb6c40b1a699_del complete
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:46 user nova-compute[75020]: INFO nova.compute.manager [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 10:57:46 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:57:46 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:48 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Took 1.18 seconds to deallocate network for instance.
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-d2edcd83-55e1-44a1-91ba-a81c1a5c0d9f req-186dc845-5d98-46ec-9b98-9b8ab874e35b service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-deleted-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:57:48 user nova-compute[75020]: INFO nova.compute.claims [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Claim successful on node user
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-2880f70c-906a-42e9-bac2-e75ce8cb867f req-22ef6039-2a67-4101-ae81-ffb00d19e57d service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2880f70c-906a-42e9-bac2-e75ce8cb867f req-22ef6039-2a67-4101-ae81-ffb00d19e57d service nova] Acquiring lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2880f70c-906a-42e9-bac2-e75ce8cb867f req-22ef6039-2a67-4101-ae81-ffb00d19e57d service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2880f70c-906a-42e9-bac2-e75ce8cb867f req-22ef6039-2a67-4101-ae81-ffb00d19e57d service nova] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-2880f70c-906a-42e9-bac2-e75ce8cb867f req-22ef6039-2a67-4101-ae81-ffb00d19e57d service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] No waiting events found dispatching network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:57:48 user nova-compute[75020]: WARNING nova.compute.manager [req-2880f70c-906a-42e9-bac2-e75ce8cb867f req-22ef6039-2a67-4101-ae81-ffb00d19e57d service nova] [instance: 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699] Received unexpected event network-vif-plugged-d3370635-c4d4-4dc7-8a3c-a3dd2756dff0 for instance with vm_state deleted and task_state None.
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.641s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:57:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:57:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:57:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:57:49 user nova-compute[75020]: INFO nova.virt.block_device [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Booting with volume snapshot 44fb9d8c-e162-4221-898c-e93260b66e31 at /dev/vda
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG nova.policy [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19afae8899f440c78b8a442361d5b531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c52e77c7064c97bc18c9df58ae20ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.644s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:49 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Deleted allocations for instance 829d8ebf-f5d9-4c51-80d1-fb6c40b1a699
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-dff073b0-d5f6-477a-b2f2-b4d896d265df tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "829d8ebf-f5d9-4c51-80d1-fb6c40b1a699" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.706s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:50 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:57:50 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7450MB free_disk=25.072166442871094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Successfully created port: 69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance fae5310f-5516-4349-ad31-4df9453171a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 875f4516-89d8-432e-aaee-840162613ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:57:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Successfully updated port: 69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "refresh_cache-b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquired lock "refresh_cache-b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-fc66dbd3-4038-4375-a2b4-5b88ab1ae226 req-17b2918f-e634-4fcd-be1e-5a554999389b service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received event network-changed-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-fc66dbd3-4038-4375-a2b4-5b88ab1ae226 req-17b2918f-e634-4fcd-be1e-5a554999389b service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Refreshing instance network info cache due to event network-changed-69ac1e82-691b-456a-bf81-65a2a0aaadb9. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc66dbd3-4038-4375-a2b4-5b88ab1ae226 req-17b2918f-e634-4fcd-be1e-5a554999389b service nova] Acquiring lock "refresh_cache-b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Updating instance_info_cache with network_info: [{"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Releasing lock "refresh_cache-b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Instance network_info: |[{"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc66dbd3-4038-4375-a2b4-5b88ab1ae226 req-17b2918f-e634-4fcd-be1e-5a554999389b service nova] Acquired lock "refresh_cache-b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG nova.network.neutron [req-fc66dbd3-4038-4375-a2b4-5b88ab1ae226 req-17b2918f-e634-4fcd-be1e-5a554999389b service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Refreshing network info cache for port 69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:57:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:52 user nova-compute[75020]: DEBUG nova.network.neutron [req-fc66dbd3-4038-4375-a2b4-5b88ab1ae226 req-17b2918f-e634-4fcd-be1e-5a554999389b service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Updated VIF entry in instance network info cache for port 69ac1e82-691b-456a-bf81-65a2a0aaadb9. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:57:52 user nova-compute[75020]: DEBUG nova.network.neutron [req-fc66dbd3-4038-4375-a2b4-5b88ab1ae226 req-17b2918f-e634-4fcd-be1e-5a554999389b service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Updating instance_info_cache with network_info: [{"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fc66dbd3-4038-4375-a2b4-5b88ab1ae226 req-17b2918f-e634-4fcd-be1e-5a554999389b service nova] Releasing lock "refresh_cache-b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:57:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:57:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:57:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:57:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-a9eeaa8e-21ea-4f61-9859-838bd45f05e4 req-21f6d5ba-6855-46b7-93b8-3b6fb6d8d25d service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-changed-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-a9eeaa8e-21ea-4f61-9859-838bd45f05e4 req-21f6d5ba-6855-46b7-93b8-3b6fb6d8d25d service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Refreshing instance network info cache due to event network-changed-267a3846-2deb-4b5f-9dd9-5475b91be177. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9eeaa8e-21ea-4f61-9859-838bd45f05e4 req-21f6d5ba-6855-46b7-93b8-3b6fb6d8d25d service nova] Acquiring lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9eeaa8e-21ea-4f61-9859-838bd45f05e4 req-21f6d5ba-6855-46b7-93b8-3b6fb6d8d25d service nova] Acquired lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.network.neutron [req-a9eeaa8e-21ea-4f61-9859-838bd45f05e4 req-21f6d5ba-6855-46b7-93b8-3b6fb6d8d25d service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Refreshing network info cache for port 267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'flavor' on Instance uuid 875f4516-89d8-432e-aaee-840162613ba1 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating instance_info_cache with network_info: [{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.network.neutron [req-a9eeaa8e-21ea-4f61-9859-838bd45f05e4 req-21f6d5ba-6855-46b7-93b8-3b6fb6d8d25d service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updated VIF entry in instance network info cache for port 267a3846-2deb-4b5f-9dd9-5475b91be177. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.network.neutron [req-a9eeaa8e-21ea-4f61-9859-838bd45f05e4 req-21f6d5ba-6855-46b7-93b8-3b6fb6d8d25d service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updating instance_info_cache with network_info: [{"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9eeaa8e-21ea-4f61-9859-838bd45f05e4 req-21f6d5ba-6855-46b7-93b8-3b6fb6d8d25d service nova] Releasing lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:57:53 user nova-compute[75020]: INFO nova.compute.manager [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Attaching volume 3614128a-5659-4343-9e4c-bedb7fd76fa0 to /dev/vdb
Nov 30 10:57:53 user nova-compute[75020]: DEBUG os_brick.utils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c99f851-19e0-49aa-ad3e-0b3c76cc1ece]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0ea5e5-2286-41cb-9d9b-fb2653113bee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bbe89c-06df-4b21-918f-58fc4be6daa5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d9270b-3173-43cc-bfdb-6479f01ab589]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:57:53 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:57:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bbc5ab-ea6c-495a-868a-a6f851ac1624]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG os_brick.utils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:57:53 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updating existing volume attachment record: b3f969ee-0a33-4857-8587-89c953dfe529 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG os_brick.utils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e078eb16-5dd5-4d5c-b514-c0410eb8a42c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6c4916-f7f4-4ebe-ab8d-aed5f09b3735]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8324f777-dfc5-4660-945b-7fc0fe42ce25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01812e1-105c-4676-99e1-de0bacbfff20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:57:55 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:57:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7be0895-bfc7-48b7-abf5-154027e39e31]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG os_brick.utils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:57:55 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Updating existing volume attachment record: 98d08aa8-1b5b-42fc-bb3b-af3a1d08e935 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:57:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:57:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:58:10 user nova-compute[75020]: INFO nova.compute.manager [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] instance snapshotting
Nov 30 10:58:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Beginning live snapshot process
Nov 30 10:58:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json -f qcow2 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json -f qcow2 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.202s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy8pxj9dh/d890faf7ff5f4a6bb7ef12802605e870.delta 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy8pxj9dh/d890faf7ff5f4a6bb7ef12802605e870.delta 1073741824" returned: 0 in 0.048s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 10:58:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiPABYbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:58:11 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:58:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:58:11 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:58:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:58:11 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[de17ee0e-97f0-4dc3-b031-10557e3ad9d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:58:11 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[862bfbae-d060-46f7-8422-66d816e4c573]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0] added
Nov 30 10:58:11 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[441aaf04-16ae-4a29-8007-ad870fb00f4a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8120b-80da-4778-96a5-663ce5782891]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiPABYbQ {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiPABYbQ" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e64ab94-7b7c-4146-b900-89164867ce6d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aiPABYbQ'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[59267234-6270-4a80-8de9-c4c9856ce84f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6933e29-0f2d-45b0-a607-b64f4efc2697]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:58:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:58:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Creating image(s)
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Ensure instance console log exists: /opt/stack/data/nova/instances/b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Start _get_guest_xml network_info=[{"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '98d08aa8-1b5b-42fc-bb3b-af3a1d08e935', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqJiLwFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f', 'attached_at': '', 'detached_at': '', 'volume_id': '5e09d370-e70a-4556-8ca3-7696805e0ba2', 'serial': '5e09d370-e70a-4556-8ca3-7696805e0ba2'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:58:12 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:58:12 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec24af-1ece-4dbc-a43c-c310a1c67469]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0, portal: 172.16.0.220,3260]
Nov 30 10:58:12 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0, portal: 172.16.0.220,3260] successful.
Nov 30 10:58:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqJiLwFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:58:12 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94851ad-cf83-4ca5-bcf8-e2720174e7c4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy8pxj9dh/d890faf7ff5f4a6bb7ef12802605e870.delta /opt/stack/data/nova/instances/snapshots/tmpy8pxj9dh/d890faf7ff5f4a6bb7ef12802605e870 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7053772-9ba9-410b-98c7-d55cc2d564f2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)
Nov 30 10:58:12 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2476d01-ab1d-44ab-8856-2e063bb63427]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiPABYbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:58:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy8pxj9dh/d890faf7ff5f4a6bb7ef12802605e870.delta /opt/stack/data/nova/instances/snapshots/tmpy8pxj9dh/d890faf7ff5f4a6bb7ef12802605e870" returned: 0 in 0.409s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Snapshot extracted, beginning image upload
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23162376231393539', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162376231393539', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.111s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:58:13 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:58:13 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'flavor' on Instance uuid 875f4516-89d8-432e-aaee-840162613ba1 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[66994f9b-115e-4497-9f5f-b53758ba6e5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:58:13 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 10:58:13 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:58:13 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 10:58:13 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:58:13 user nova-compute[75020]:   <serial>3614128a-5659-4343-9e4c-bedb7fd76fa0</serial>
Nov 30 10:58:13 user nova-compute[75020]: </disk>
Nov 30 10:58:13 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0abb84-74f4-4401-9514-2066008b5a22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2] added
Nov 30 10:58:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ba98d-23f2-4e0f-8656-be02d07787be]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e158952b-0839-4960-bb62-a63b4af76580]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqJiLwFG {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqJiLwFG" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2e72cb-691d-4739-9faa-d3d873a1e47d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KqJiLwFG'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[97890c9f-cbcb-4225-b650-0bc048e002ab]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb003c6-d95c-4700-a960-2af69f539a79]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af18f4e-7517-42c8-9862-1111e51c1f7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2, portal: 172.16.0.220,3260]
Nov 30 10:58:13 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2, portal: 172.16.0.220,3260] successful.
Nov 30 10:58:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca59bd8-3e0b-48f1-a55d-b3020de69b37]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[96320775-b1f9-4e27-95b5-547aefe694c4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:58:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adebd1a-e1f6-45ac-a4bd-397e39231f95]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No VIF found with MAC fa:16:3e:60:7d:40, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:58:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2df117b8-2171-4197-97fe-35f1bc268d99 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.144s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqJiLwFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== connect_volume: return (2452ms) {'type': 'block', 'scsi_wwn': '23964656436323136', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964656436323136', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-126354465',display_name='tempest-TestVolumeBootPattern-server-126354465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-126354465',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-2gn0ztwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:57:49Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e1:1f,bridge_name='br-int',has_traffic_filtering=True,id=69ac1e82-691b-456a-bf81-65a2a0aaadb9,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ac1e82-69') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'pci_devices' on Instance uuid b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:58:14 user nova-compute[75020]:   <uuid>b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f</uuid>
Nov 30 10:58:14 user nova-compute[75020]:   <name>instance-00000019</name>
Nov 30 10:58:14 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:58:14 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:58:14 user nova-compute[75020]:   <metadata>
Nov 30 10:58:14 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:58:14 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:58:14 user nova-compute[75020]:       <nova:name>tempest-TestVolumeBootPattern-server-126354465</nova:name>
Nov 30 10:58:14 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:58:12</nova:creationTime>
Nov 30 10:58:14 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:58:14 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:58:14 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:58:14 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:58:14 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:58:14 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:58:14 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:58:14 user nova-compute[75020]:       <nova:owner>
Nov 30 10:58:14 user nova-compute[75020]:         <nova:user uuid="19afae8899f440c78b8a442361d5b531">tempest-TestVolumeBootPattern-1120216767-project-member</nova:user>
Nov 30 10:58:14 user nova-compute[75020]:         <nova:project uuid="54c52e77c7064c97bc18c9df58ae20ef">tempest-TestVolumeBootPattern-1120216767</nova:project>
Nov 30 10:58:14 user nova-compute[75020]:       </nova:owner>
Nov 30 10:58:14 user nova-compute[75020]:       <nova:ports>
Nov 30 10:58:14 user nova-compute[75020]:         <nova:port uuid="69ac1e82-691b-456a-bf81-65a2a0aaadb9">
Nov 30 10:58:14 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 10:58:14 user nova-compute[75020]:         </nova:port>
Nov 30 10:58:14 user nova-compute[75020]:       </nova:ports>
Nov 30 10:58:14 user nova-compute[75020]:     </nova:instance>
Nov 30 10:58:14 user nova-compute[75020]:   </metadata>
Nov 30 10:58:14 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:58:14 user nova-compute[75020]:     <system>
Nov 30 10:58:14 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:58:14 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:58:14 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:58:14 user nova-compute[75020]:       <entry name="serial">b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f</entry>
Nov 30 10:58:14 user nova-compute[75020]:       <entry name="uuid">b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f</entry>
Nov 30 10:58:14 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:58:14 user nova-compute[75020]:     </system>
Nov 30 10:58:14 user nova-compute[75020]:   </sysinfo>
Nov 30 10:58:14 user nova-compute[75020]:   <os>
Nov 30 10:58:14 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:58:14 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:58:14 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:58:14 user nova-compute[75020]:   </os>
Nov 30 10:58:14 user nova-compute[75020]:   <features>
Nov 30 10:58:14 user nova-compute[75020]:     <acpi/>
Nov 30 10:58:14 user nova-compute[75020]:     <apic/>
Nov 30 10:58:14 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:58:14 user nova-compute[75020]:   </features>
Nov 30 10:58:14 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:58:14 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:58:14 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:58:14 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:58:14 user nova-compute[75020]:   </clock>
Nov 30 10:58:14 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:58:14 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:58:14 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:58:14 user nova-compute[75020]:   </cpu>
Nov 30 10:58:14 user nova-compute[75020]:   <devices>
Nov 30 10:58:14 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:58:14 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:58:14 user nova-compute[75020]:       <source dev="/dev/sde"/>
Nov 30 10:58:14 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:58:14 user nova-compute[75020]:       <serial>5e09d370-e70a-4556-8ca3-7696805e0ba2</serial>
Nov 30 10:58:14 user nova-compute[75020]:     </disk>
Nov 30 10:58:14 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:58:14 user nova-compute[75020]:       <mac address="fa:16:3e:86:e1:1f"/>
Nov 30 10:58:14 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:58:14 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:58:14 user nova-compute[75020]:       <target dev="tap69ac1e82-69"/>
Nov 30 10:58:14 user nova-compute[75020]:     </interface>
Nov 30 10:58:14 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:58:14 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f/console.log" append="off"/>
Nov 30 10:58:14 user nova-compute[75020]:     </serial>
Nov 30 10:58:14 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:58:14 user nova-compute[75020]:     <video>
Nov 30 10:58:14 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:58:14 user nova-compute[75020]:     </video>
Nov 30 10:58:14 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:58:14 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:58:14 user nova-compute[75020]:     </rng>
Nov 30 10:58:14 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:58:14 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:58:14 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:58:14 user nova-compute[75020]:     </memballoon>
Nov 30 10:58:14 user nova-compute[75020]:   </devices>
Nov 30 10:58:14 user nova-compute[75020]: </domain>
Nov 30 10:58:14 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-126354465',display_name='tempest-TestVolumeBootPattern-server-126354465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-126354465',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-2gn0ztwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:57:49Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e1:1f,bridge_name='br-int',has_traffic_filtering=True,id=69ac1e82-691b-456a-bf81-65a2a0aaadb9,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ac1e82-69') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG os_vif [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e1:1f,bridge_name='br-int',has_traffic_filtering=True,id=69ac1e82-691b-456a-bf81-65a2a0aaadb9,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ac1e82-69') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a352e791-7e1f-508a-b442-0cb17d7ebf52', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69ac1e82-69, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69ac1e82-69, col_values=(('qos', UUID('6fea5582-c83a-4ed7-bec3-d5f8955140e5')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69ac1e82-69, col_values=(('external_ids', {'iface-id': '69ac1e82-691b-456a-bf81-65a2a0aaadb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:e1:1f', 'vm-uuid': 'b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:14 user nova-compute[75020]: INFO os_vif [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e1:1f,bridge_name='br-int',has_traffic_filtering=True,id=69ac1e82-691b-456a-bf81-65a2a0aaadb9,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ac1e82-69')
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:58:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No VIF found with MAC fa:16:3e:86:e1:1f, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:58:15 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Snapshot image upload complete
Nov 30 10:58:15 user nova-compute[75020]: INFO nova.compute.manager [None req-4ae9e972-881c-4b2f-8d05-8617b1ea97c1 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Took 5.21 seconds to snapshot the instance on the hypervisor.
Nov 30 10:58:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:15 user nova-compute[75020]: INFO nova.compute.manager [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Detaching volume 3614128a-5659-4343-9e4c-bedb7fd76fa0
Nov 30 10:58:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:16 user nova-compute[75020]: INFO nova.virt.block_device [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Attempting to driver detach volume 3614128a-5659-4343-9e4c-bedb7fd76fa0 from mountpoint /dev/vdb
Nov 30 10:58:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Attempting to detach device vdb from instance 875f4516-89d8-432e-aaee-840162613ba1 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:58:16 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:58:16 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 10:58:16 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:58:16 user nova-compute[75020]:   <serial>3614128a-5659-4343-9e4c-bedb7fd76fa0</serial>
Nov 30 10:58:16 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:58:16 user nova-compute[75020]: </disk>
Nov 30 10:58:16 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:58:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Successfully detached device vdb from instance 875f4516-89d8-432e-aaee-840162613ba1 from the persistent domain config.
Nov 30 10:58:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 875f4516-89d8-432e-aaee-840162613ba1 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:58:16 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:58:16 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 10:58:16 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:58:16 user nova-compute[75020]:   <serial>3614128a-5659-4343-9e4c-bedb7fd76fa0</serial>
Nov 30 10:58:16 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:58:16 user nova-compute[75020]: </disk>
Nov 30 10:58:16 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-a54a2135-ad46-45aa-9086-c2cecd071772 req-ffd1105c-a179-4867-9855-dbaac146caaf service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received event network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a54a2135-ad46-45aa-9086-c2cecd071772 req-ffd1105c-a179-4867-9855-dbaac146caaf service nova] Acquiring lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a54a2135-ad46-45aa-9086-c2cecd071772 req-ffd1105c-a179-4867-9855-dbaac146caaf service nova] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a54a2135-ad46-45aa-9086-c2cecd071772 req-ffd1105c-a179-4867-9855-dbaac146caaf service nova] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-a54a2135-ad46-45aa-9086-c2cecd071772 req-ffd1105c-a179-4867-9855-dbaac146caaf service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] No waiting events found dispatching network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:58:16 user nova-compute[75020]: WARNING nova.compute.manager [req-a54a2135-ad46-45aa-9086-c2cecd071772 req-ffd1105c-a179-4867-9855-dbaac146caaf service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received unexpected event network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 for instance with vm_state building and task_state spawning.
Nov 30 10:58:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 875f4516-89d8-432e-aaee-840162613ba1 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-d1bd3c67-0a7a-4f6d-9c3c-63ca1be7de31 req-f1152711-9124-4497-bc9c-8006f23271fe service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received event network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d1bd3c67-0a7a-4f6d-9c3c-63ca1be7de31 req-f1152711-9124-4497-bc9c-8006f23271fe service nova] Acquiring lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d1bd3c67-0a7a-4f6d-9c3c-63ca1be7de31 req-f1152711-9124-4497-bc9c-8006f23271fe service nova] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d1bd3c67-0a7a-4f6d-9c3c-63ca1be7de31 req-f1152711-9124-4497-bc9c-8006f23271fe service nova] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-d1bd3c67-0a7a-4f6d-9c3c-63ca1be7de31 req-f1152711-9124-4497-bc9c-8006f23271fe service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] No waiting events found dispatching network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:58:18 user nova-compute[75020]: WARNING nova.compute.manager [req-d1bd3c67-0a7a-4f6d-9c3c-63ca1be7de31 req-f1152711-9124-4497-bc9c-8006f23271fe service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received unexpected event network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 for instance with vm_state building and task_state spawning.
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:58:18 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Instance spawned successfully.
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:18 user nova-compute[75020]: INFO nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 30 10:58:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:58:18 user nova-compute[75020]: INFO nova.compute.manager [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Took 30.43 seconds to build instance.
Nov 30 10:58:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f0f91fad-26dc-4862-9042-94df9f72db01 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.617s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:19 user nova-compute[75020]: INFO nova.compute.manager [None req-30914c0a-1906-4be2-8267-62c73fd91f99 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Unrescuing
Nov 30 10:58:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-30914c0a-1906-4be2-8267-62c73fd91f99 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-30914c0a-1906-4be2-8267-62c73fd91f99 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquired lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG nova.network.neutron [None req-30914c0a-1906-4be2-8267-62c73fd91f99 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG nova.network.neutron [None req-30914c0a-1906-4be2-8267-62c73fd91f99 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating instance_info_cache with network_info: [{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-30914c0a-1906-4be2-8267-62c73fd91f99 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Releasing lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG nova.objects.instance [None req-30914c0a-1906-4be2-8267-62c73fd91f99 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'flavor' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-d84f0260-1266-4f1d-9af4-23d825809479 req-5d538d70-d837-4cc0-965b-d87d90393c35 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d84f0260-1266-4f1d-9af4-23d825809479 req-5d538d70-d837-4cc0-965b-d87d90393c35 service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d84f0260-1266-4f1d-9af4-23d825809479 req-5d538d70-d837-4cc0-965b-d87d90393c35 service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d84f0260-1266-4f1d-9af4-23d825809479 req-5d538d70-d837-4cc0-965b-d87d90393c35 service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-d84f0260-1266-4f1d-9af4-23d825809479 req-5d538d70-d837-4cc0-965b-d87d90393c35 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:58:20 user nova-compute[75020]: WARNING nova.compute.manager [req-d84f0260-1266-4f1d-9af4-23d825809479 req-5d538d70-d837-4cc0-965b-d87d90393c35 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state rescued and task_state unrescuing.
Nov 30 10:58:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-06313f15-a2b0-4ba4-8b8b-b0a4a03d3bec req-c0854f70-895a-4d40-b0b8-27d91466611a service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-changed-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-06313f15-a2b0-4ba4-8b8b-b0a4a03d3bec req-c0854f70-895a-4d40-b0b8-27d91466611a service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Refreshing instance network info cache due to event network-changed-3a7eecf5-e982-408c-a25e-885e6d940868. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06313f15-a2b0-4ba4-8b8b-b0a4a03d3bec req-c0854f70-895a-4d40-b0b8-27d91466611a service nova] Acquiring lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06313f15-a2b0-4ba4-8b8b-b0a4a03d3bec req-c0854f70-895a-4d40-b0b8-27d91466611a service nova] Acquired lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-06313f15-a2b0-4ba4-8b8b-b0a4a03d3bec req-c0854f70-895a-4d40-b0b8-27d91466611a service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Refreshing network info cache for port 3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:20 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance destroyed successfully.
Nov 30 10:58:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-06313f15-a2b0-4ba4-8b8b-b0a4a03d3bec req-c0854f70-895a-4d40-b0b8-27d91466611a service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updated VIF entry in instance network info cache for port 3a7eecf5-e982-408c-a25e-885e6d940868. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-06313f15-a2b0-4ba4-8b8b-b0a4a03d3bec req-c0854f70-895a-4d40-b0b8-27d91466611a service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating instance_info_cache with network_info: [{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:58:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06313f15-a2b0-4ba4-8b8b-b0a4a03d3bec req-c0854f70-895a-4d40-b0b8-27d91466611a service nova] Releasing lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:58:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:58:22 user nova-compute[75020]: WARNING nova.compute.manager [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state rescued and task_state unrescuing.
Nov 30 10:58:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:58:22 user nova-compute[75020]: WARNING nova.compute.manager [req-7cb77135-73bb-4d35-9ba5-07c4e299ed48 req-8587c68e-26a2-4ca7-a039-8dfffbd0e5d4 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state rescued and task_state unrescuing.
Nov 30 10:58:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-43038201-0dcb-4f8a-a078-caf2d382116f req-33e6f3bc-b749-4644-8009-f14e4e81ad52 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-changed-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-43038201-0dcb-4f8a-a078-caf2d382116f req-33e6f3bc-b749-4644-8009-f14e4e81ad52 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Refreshing instance network info cache due to event network-changed-3a7eecf5-e982-408c-a25e-885e6d940868. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-43038201-0dcb-4f8a-a078-caf2d382116f req-33e6f3bc-b749-4644-8009-f14e4e81ad52 service nova] Acquiring lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-43038201-0dcb-4f8a-a078-caf2d382116f req-33e6f3bc-b749-4644-8009-f14e4e81ad52 service nova] Acquired lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-43038201-0dcb-4f8a-a078-caf2d382116f req-33e6f3bc-b749-4644-8009-f14e4e81ad52 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Refreshing network info cache for port 3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-43038201-0dcb-4f8a-a078-caf2d382116f req-33e6f3bc-b749-4644-8009-f14e4e81ad52 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updated VIF entry in instance network info cache for port 3a7eecf5-e982-408c-a25e-885e6d940868. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:58:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-43038201-0dcb-4f8a-a078-caf2d382116f req-33e6f3bc-b749-4644-8009-f14e4e81ad52 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating instance_info_cache with network_info: [{"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:58:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-43038201-0dcb-4f8a-a078-caf2d382116f req-33e6f3bc-b749-4644-8009-f14e4e81ad52 service nova] Releasing lock "refresh_cache-fae5310f-5516-4349-ad31-4df9453171a7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:58:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:24 user nova-compute[75020]: DEBUG nova.compute.manager [None req-30914c0a-1906-4be2-8267-62c73fd91f99 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:58:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb52b6ef-33f0-4921-847e-b81925f019f7 req-043920e4-55bc-4563-83c7-9ff7c439b28e service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb52b6ef-33f0-4921-847e-b81925f019f7 req-043920e4-55bc-4563-83c7-9ff7c439b28e service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb52b6ef-33f0-4921-847e-b81925f019f7 req-043920e4-55bc-4563-83c7-9ff7c439b28e service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb52b6ef-33f0-4921-847e-b81925f019f7 req-043920e4-55bc-4563-83c7-9ff7c439b28e service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb52b6ef-33f0-4921-847e-b81925f019f7 req-043920e4-55bc-4563-83c7-9ff7c439b28e service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:58:24 user nova-compute[75020]: WARNING nova.compute.manager [req-eb52b6ef-33f0-4921-847e-b81925f019f7 req-043920e4-55bc-4563-83c7-9ff7c439b28e service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state rescued and task_state unrescuing.
Nov 30 10:58:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 875f4516-89d8-432e-aaee-840162613ba1 is timed out.
Nov 30 10:58:36 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Successfully detached device vdb from instance 875f4516-89d8-432e-aaee-840162613ba1 from the live domain config.
Nov 30 10:58:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiPABYbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:58:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e765d9-a877-475e-a066-05cf040d9f45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:58:36 user nova-compute[75020]: No targets found.
Nov 30 10:58:36 user nova-compute[75020]: iSNS:
Nov 30 10:58:36 user nova-compute[75020]: No targets found.
Nov 30 10:58:36 user nova-compute[75020]: STATIC:
Nov 30 10:58:36 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2
Nov 30 10:58:36 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:58:36 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:58:36 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0
Nov 30 10:58:36 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:58:36 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:58:36 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426
Nov 30 10:58:36 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:58:36 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:58:36 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:58:36 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:58:36 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:58:36 user nova-compute[75020]: FIRMWARE:
Nov 30 10:58:36 user nova-compute[75020]: No targets found.
Nov 30 10:58:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:58:36 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:58:36 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb0acce-f578-4c8c-8fb3-8abba436c6c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4fbc38-ed63-4e55-91ce-26e902df357d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:36 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:36 user nova-compute[75020]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)
Nov 30 10:58:36 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:58:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:58:36 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:58:36 user nova-compute[75020]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 (non-flash)
Nov 30 10:58:36 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:58:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada84141f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0'): ({'sdd'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Removing single pathed devices sdd {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f4a84f-b4bd-47c4-869a-b4d6bb6d4e85]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea8bc55-518d-43a4-85ad-3508982a93c3]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Flushing IO for device /dev/sdd {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9434147-bfad-4458-af90-554f686088d4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f71c13-e575-4188-a641-ca0e17fe8ff7]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a18e1f3-f397-4683-89d0-b9cd40bd2156]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf487ed-f3e2-4679-867c-be0073560827]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0, portal: 172.16.0.220,3260]
Nov 30 10:58:36 user nova-compute[75020]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0, portal: 172.16.0.220,3260] successful.
Nov 30 10:58:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614128a-5659-4343-9e4c-bedb7fd76fa0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[266add86-5714-4db5-919d-845048a61038]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:58:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:58:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:58:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] <== disconnect_volume: return (343ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:58:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:58:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'flavor' on Instance uuid 875f4516-89d8-432e-aaee-840162613ba1 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:58:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-162ebc14-a094-4d1a-abbc-bd7e1692d565 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.968s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:58:40 user nova-compute[75020]: INFO nova.compute.claims [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Claim successful on node user
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:58:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:58:40 user nova-compute[75020]: DEBUG nova.policy [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007e7cb60a1540c0a4168b27b2c92e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2765886644e4b5eb42a29eb8c0a82e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:58:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Creating image(s)
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "/opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "/opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "/opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.156s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk 1073741824" returned: 0 in 0.051s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Successfully created port: 088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 10:58:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Cannot resize image /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Ensure instance console log exists: /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Successfully updated port: 088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquired lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-33378b5b-616a-4135-a6d8-94a79ab53e3f req-a67be6fc-b7ac-4771-bf4d-af8049558f0c service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received event network-changed-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-33378b5b-616a-4135-a6d8-94a79ab53e3f req-a67be6fc-b7ac-4771-bf4d-af8049558f0c service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Refreshing instance network info cache due to event network-changed-088ea6c2-0c4a-4f91-8464-f9c56da8f397. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-33378b5b-616a-4135-a6d8-94a79ab53e3f req-a67be6fc-b7ac-4771-bf4d-af8049558f0c service nova] Acquiring lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updating instance_info_cache with network_info: [{"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Releasing lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Instance network_info: |[{"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-33378b5b-616a-4135-a6d8-94a79ab53e3f req-a67be6fc-b7ac-4771-bf4d-af8049558f0c service nova] Acquired lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.network.neutron [req-33378b5b-616a-4135-a6d8-94a79ab53e3f req-a67be6fc-b7ac-4771-bf4d-af8049558f0c service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Refreshing network info cache for port 088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Start _get_guest_xml network_info=[{"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:58:42 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:58:42 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1910170197',display_name='tempest-AttachVolumeTestJSON-server-1910170197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1910170197',id=26,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKujSzC3oZ0MX2KhjmmjEcx5rwT8JLGaLymoesOsVO57fC5FwPnDHGrH4p82/d6lRDT+6bptkz2N9Hv/IUfhTPUCRNMWs8o9toN9yU89dLTRHLhus64qpzVWIBHmRbsGkg==',key_name='tempest-keypair-1535642839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-0vjft97p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=61543d0a-92b8-4276-8301-4620468f0189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=088ea6c2-0c4a-4f91-8464-f9c56da8f397,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088ea6c2-0c') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.objects.instance [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'pci_devices' on Instance uuid 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:58:42 user nova-compute[75020]:   <uuid>61543d0a-92b8-4276-8301-4620468f0189</uuid>
Nov 30 10:58:42 user nova-compute[75020]:   <name>instance-0000001a</name>
Nov 30 10:58:42 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:58:42 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:58:42 user nova-compute[75020]:   <metadata>
Nov 30 10:58:42 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:58:42 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:58:42 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeTestJSON-server-1910170197</nova:name>
Nov 30 10:58:42 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:58:42</nova:creationTime>
Nov 30 10:58:42 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:58:42 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:58:42 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:58:42 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:58:42 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:58:42 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:58:42 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:58:42 user nova-compute[75020]:       <nova:owner>
Nov 30 10:58:42 user nova-compute[75020]:         <nova:user uuid="007e7cb60a1540c0a4168b27b2c92e0b">tempest-AttachVolumeTestJSON-1562861090-project-member</nova:user>
Nov 30 10:58:42 user nova-compute[75020]:         <nova:project uuid="c2765886644e4b5eb42a29eb8c0a82e1">tempest-AttachVolumeTestJSON-1562861090</nova:project>
Nov 30 10:58:42 user nova-compute[75020]:       </nova:owner>
Nov 30 10:58:42 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:58:42 user nova-compute[75020]:       <nova:ports>
Nov 30 10:58:42 user nova-compute[75020]:         <nova:port uuid="088ea6c2-0c4a-4f91-8464-f9c56da8f397">
Nov 30 10:58:42 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 10:58:42 user nova-compute[75020]:         </nova:port>
Nov 30 10:58:42 user nova-compute[75020]:       </nova:ports>
Nov 30 10:58:42 user nova-compute[75020]:     </nova:instance>
Nov 30 10:58:42 user nova-compute[75020]:   </metadata>
Nov 30 10:58:42 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:58:42 user nova-compute[75020]:     <system>
Nov 30 10:58:42 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:58:42 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:58:42 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:58:42 user nova-compute[75020]:       <entry name="serial">61543d0a-92b8-4276-8301-4620468f0189</entry>
Nov 30 10:58:42 user nova-compute[75020]:       <entry name="uuid">61543d0a-92b8-4276-8301-4620468f0189</entry>
Nov 30 10:58:42 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:58:42 user nova-compute[75020]:     </system>
Nov 30 10:58:42 user nova-compute[75020]:   </sysinfo>
Nov 30 10:58:42 user nova-compute[75020]:   <os>
Nov 30 10:58:42 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:58:42 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:58:42 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:58:42 user nova-compute[75020]:   </os>
Nov 30 10:58:42 user nova-compute[75020]:   <features>
Nov 30 10:58:42 user nova-compute[75020]:     <acpi/>
Nov 30 10:58:42 user nova-compute[75020]:     <apic/>
Nov 30 10:58:42 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:58:42 user nova-compute[75020]:   </features>
Nov 30 10:58:42 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:58:42 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:58:42 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:58:42 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:58:42 user nova-compute[75020]:   </clock>
Nov 30 10:58:42 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:58:42 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:58:42 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:58:42 user nova-compute[75020]:   </cpu>
Nov 30 10:58:42 user nova-compute[75020]:   <devices>
Nov 30 10:58:42 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:58:42 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:58:42 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk"/>
Nov 30 10:58:42 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:58:42 user nova-compute[75020]:     </disk>
Nov 30 10:58:42 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:58:42 user nova-compute[75020]:       <mac address="fa:16:3e:f8:aa:f5"/>
Nov 30 10:58:42 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:58:42 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:58:42 user nova-compute[75020]:       <target dev="tap088ea6c2-0c"/>
Nov 30 10:58:42 user nova-compute[75020]:     </interface>
Nov 30 10:58:42 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:58:42 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/console.log" append="off"/>
Nov 30 10:58:42 user nova-compute[75020]:     </serial>
Nov 30 10:58:42 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:58:42 user nova-compute[75020]:     <video>
Nov 30 10:58:42 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:58:42 user nova-compute[75020]:     </video>
Nov 30 10:58:42 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:58:42 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:58:42 user nova-compute[75020]:     </rng>
Nov 30 10:58:42 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:58:42 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:58:42 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:58:42 user nova-compute[75020]:     </memballoon>
Nov 30 10:58:42 user nova-compute[75020]:   </devices>
Nov 30 10:58:42 user nova-compute[75020]: </domain>
Nov 30 10:58:42 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:58:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1910170197',display_name='tempest-AttachVolumeTestJSON-server-1910170197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1910170197',id=26,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKujSzC3oZ0MX2KhjmmjEcx5rwT8JLGaLymoesOsVO57fC5FwPnDHGrH4p82/d6lRDT+6bptkz2N9Hv/IUfhTPUCRNMWs8o9toN9yU89dLTRHLhus64qpzVWIBHmRbsGkg==',key_name='tempest-keypair-1535642839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-0vjft97p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=61543d0a-92b8-4276-8301-4620468f0189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=088ea6c2-0c4a-4f91-8464-f9c56da8f397,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088ea6c2-0c') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG os_vif [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=088ea6c2-0c4a-4f91-8464-f9c56da8f397,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088ea6c2-0c') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00b07b4d-da2f-546a-ada3-e472b138ee37', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap088ea6c2-0c, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap088ea6c2-0c, col_values=(('qos', UUID('253c72db-c7a8-4d22-addb-cef6ca15d9bf')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap088ea6c2-0c, col_values=(('external_ids', {'iface-id': '088ea6c2-0c4a-4f91-8464-f9c56da8f397', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:aa:f5', 'vm-uuid': '61543d0a-92b8-4276-8301-4620468f0189'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:43 user nova-compute[75020]: INFO os_vif [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=088ea6c2-0c4a-4f91-8464-f9c56da8f397,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088ea6c2-0c')
Nov 30 10:58:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No VIF found with MAC fa:16:3e:f8:aa:f5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-33378b5b-616a-4135-a6d8-94a79ab53e3f req-a67be6fc-b7ac-4771-bf4d-af8049558f0c service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updated VIF entry in instance network info cache for port 088ea6c2-0c4a-4f91-8464-f9c56da8f397. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-33378b5b-616a-4135-a6d8-94a79ab53e3f req-a67be6fc-b7ac-4771-bf4d-af8049558f0c service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updating instance_info_cache with network_info: [{"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-33378b5b-616a-4135-a6d8-94a79ab53e3f req-a67be6fc-b7ac-4771-bf4d-af8049558f0c service nova] Releasing lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:58:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-3d2bd03d-b3ed-44ea-9e31-098192ebcfa2 req-9de9a190-4588-496f-b958-a478a3dbbba9 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received event network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3d2bd03d-b3ed-44ea-9e31-098192ebcfa2 req-9de9a190-4588-496f-b958-a478a3dbbba9 service nova] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3d2bd03d-b3ed-44ea-9e31-098192ebcfa2 req-9de9a190-4588-496f-b958-a478a3dbbba9 service nova] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3d2bd03d-b3ed-44ea-9e31-098192ebcfa2 req-9de9a190-4588-496f-b958-a478a3dbbba9 service nova] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-3d2bd03d-b3ed-44ea-9e31-098192ebcfa2 req-9de9a190-4588-496f-b958-a478a3dbbba9 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] No waiting events found dispatching network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:58:45 user nova-compute[75020]: WARNING nova.compute.manager [req-3d2bd03d-b3ed-44ea-9e31-098192ebcfa2 req-9de9a190-4588-496f-b958-a478a3dbbba9 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received unexpected event network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 for instance with vm_state building and task_state spawning.
Nov 30 10:58:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:58:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Instance spawned successfully.
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:58:46 user nova-compute[75020]: INFO nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 30 10:58:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:46 user nova-compute[75020]: INFO nova.compute.manager [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Took 6.55 seconds to build instance.
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31bf57e3-686b-40db-9b02-b0c54dbec8a2 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.685s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-fce63a13-fbe3-4dd8-ba8f-2dd35f54fc59 req-4d098749-8a3a-4bdb-aef5-047acb7fa652 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received event network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fce63a13-fbe3-4dd8-ba8f-2dd35f54fc59 req-4d098749-8a3a-4bdb-aef5-047acb7fa652 service nova] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fce63a13-fbe3-4dd8-ba8f-2dd35f54fc59 req-4d098749-8a3a-4bdb-aef5-047acb7fa652 service nova] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fce63a13-fbe3-4dd8-ba8f-2dd35f54fc59 req-4d098749-8a3a-4bdb-aef5-047acb7fa652 service nova] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-fce63a13-fbe3-4dd8-ba8f-2dd35f54fc59 req-4d098749-8a3a-4bdb-aef5-047acb7fa652 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] No waiting events found dispatching network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:58:47 user nova-compute[75020]: WARNING nova.compute.manager [req-fce63a13-fbe3-4dd8-ba8f-2dd35f54fc59 req-4d098749-8a3a-4bdb-aef5-047acb7fa652 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received unexpected event network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 for instance with vm_state active and task_state None.
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:58:50 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:58:50 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=25.03897476196289GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance fae5310f-5516-4349-ad31-4df9453171a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 875f4516-89d8-432e-aaee-840162613ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 61543d0a-92b8-4276-8301-4620468f0189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 10:58:50 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 10:58:51 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:58:51 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:58:51 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:58:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:58:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:58:52 user nova-compute[75020]: INFO nova.compute.manager [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Detaching volume 17ca01e2-09ad-4a33-9d6c-412dc3748426
Nov 30 10:58:52 user nova-compute[75020]: INFO nova.virt.block_device [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Attempting to driver detach volume 17ca01e2-09ad-4a33-9d6c-412dc3748426 from mountpoint /dev/vdb
Nov 30 10:58:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Attempting to detach device vdb from instance fae5310f-5516-4349-ad31-4df9453171a7 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:58:52 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:58:52 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:58:52 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:58:52 user nova-compute[75020]:   <serial>17ca01e2-09ad-4a33-9d6c-412dc3748426</serial>
Nov 30 10:58:52 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:58:52 user nova-compute[75020]: </disk>
Nov 30 10:58:52 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:58:52 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Successfully detached device vdb from instance fae5310f-5516-4349-ad31-4df9453171a7 from the persistent domain config.
Nov 30 10:58:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fae5310f-5516-4349-ad31-4df9453171a7 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 10:58:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 10:58:52 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:58:52 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 10:58:52 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 10:58:52 user nova-compute[75020]:   <serial>17ca01e2-09ad-4a33-9d6c-412dc3748426</serial>
Nov 30 10:58:52 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 10:58:52 user nova-compute[75020]: </disk>
Nov 30 10:58:52 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Updating instance_info_cache with network_info: [{"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-d7b8ec6d-d309-41dd-bfac-ba8b079fa979" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:58:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:58:55 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:55 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 10:58:55 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 10:58:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:58:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 10:58:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:03 user nova-compute[75020]: INFO nova.compute.manager [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Unshelving
Nov 30 10:59:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG nova.objects.instance [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'pci_requests' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG nova.objects.instance [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'numa_topology' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:59:03 user nova-compute[75020]: INFO nova.compute.claims [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Claim successful on node user
Nov 30 10:59:03 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:59:03 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:59:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:04 user nova-compute[75020]: INFO nova.network.neutron [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating port aefbdff1-5f9b-4314-9563-07ebbe7a0f48 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 10:59:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquired lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:04 user nova-compute[75020]: DEBUG nova.network.neutron [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:59:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-6eb65157-9c0a-4577-bbcf-3960bd1d406d req-8f6adb54-58f7-4a5b-a370-46cf51f2b3a6 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-changed-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-6eb65157-9c0a-4577-bbcf-3960bd1d406d req-8f6adb54-58f7-4a5b-a370-46cf51f2b3a6 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Refreshing instance network info cache due to event network-changed-aefbdff1-5f9b-4314-9563-07ebbe7a0f48. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:59:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6eb65157-9c0a-4577-bbcf-3960bd1d406d req-8f6adb54-58f7-4a5b-a370-46cf51f2b3a6 service nova] Acquiring lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating instance_info_cache with network_info: [{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Releasing lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:59:05 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Creating image(s)
Nov 30 10:59:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG nova.objects.instance [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'trusted_certs' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6eb65157-9c0a-4577-bbcf-3960bd1d406d req-8f6adb54-58f7-4a5b-a370-46cf51f2b3a6 service nova] Acquired lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG nova.network.neutron [req-6eb65157-9c0a-4577-bbcf-3960bd1d406d req-8f6adb54-58f7-4a5b-a370-46cf51f2b3a6 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Refreshing network info cache for port aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG nova.objects.base [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<e35772a3-9a06-4ae7-bf6d-e433fee4dee6> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG nova.virt.images [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] e9d179d7-f28f-4ef3-b270-6b032f4a166b was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0.part /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-6eb65157-9c0a-4577-bbcf-3960bd1d406d req-8f6adb54-58f7-4a5b-a370-46cf51f2b3a6 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updated VIF entry in instance network info cache for port aefbdff1-5f9b-4314-9563-07ebbe7a0f48. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG nova.network.neutron [req-6eb65157-9c0a-4577-bbcf-3960bd1d406d req-8f6adb54-58f7-4a5b-a370-46cf51f2b3a6 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating instance_info_cache with network_info: [{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0.part /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0.converted" returned: 0 in 0.291s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6eb65157-9c0a-4577-bbcf-3960bd1d406d req-8f6adb54-58f7-4a5b-a370-46cf51f2b3a6 service nova] Releasing lock "refresh_cache-e35772a3-9a06-4ae7-bf6d-e433fee4dee6" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.434s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0 --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0 --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0,backing_fmt=raw /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0,backing_fmt=raw /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk 1073741824" returned: 0 in 0.049s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0 --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:07 user nova-compute[75020]: DEBUG nova.objects.instance [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'migration_context' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:07 user nova-compute[75020]: DEBUG nova.objects.base [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<e35772a3-9a06-4ae7-bf6d-e433fee4dee6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:07 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Rebasing disk image.
Nov 30 10:59:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 -F raw /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 -F raw /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk" returned: 0 in 2.027s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Ensure instance console log exists: /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Start _get_guest_xml network_info=[{"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c34e1c8ad57c0e972753b966092c3c3b',container_format='bare',created_at=2023-11-30T10:57:11Z,direct_url=<?>,disk_format='qcow2',id=e9d179d7-f28f-4ef3-b270-6b032f4a166b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1109579761-shelved',owner='0b0cce29854643d0b730dc664697dee7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T10:57:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:59:09 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:09 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c34e1c8ad57c0e972753b966092c3c3b',container_format='bare',created_at=2023-11-30T10:57:11Z,direct_url=<?>,disk_format='qcow2',id=e9d179d7-f28f-4ef3-b270-6b032f4a166b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1109579761-shelved',owner='0b0cce29854643d0b730dc664697dee7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T10:57:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'vcpu_model' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.objects.base [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<e35772a3-9a06-4ae7-bf6d-e433fee4dee6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109579761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109579761',id=22,image_ref='e9d179d7-f28f-4ef3-b270-6b032f4a166b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1490479026',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-a1bndffv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member',shelved_at='2023-11-30T10:57:16.012532',shelved_host='user',shelved_image_id='e9d179d7-f28f-4ef3-b270-6b032f4a166b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=e35772a3-9a06-4ae7-bf6d-e433fee4dee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'pci_devices' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.objects.base [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Object Instance<e35772a3-9a06-4ae7-bf6d-e433fee4dee6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:59:09 user nova-compute[75020]:   <uuid>e35772a3-9a06-4ae7-bf6d-e433fee4dee6</uuid>
Nov 30 10:59:09 user nova-compute[75020]:   <name>instance-00000016</name>
Nov 30 10:59:09 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:59:09 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:59:09 user nova-compute[75020]:   <metadata>
Nov 30 10:59:09 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:59:09 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:59:09 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1109579761</nova:name>
Nov 30 10:59:09 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:59:09</nova:creationTime>
Nov 30 10:59:09 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:59:09 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:59:09 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:59:09 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:59:09 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:59:09 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:59:09 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:59:09 user nova-compute[75020]:       <nova:owner>
Nov 30 10:59:09 user nova-compute[75020]:         <nova:user uuid="5d431a8177f54de08c3d0c03a3c9ff1e">tempest-AttachVolumeShelveTestJSON-1553674360-project-member</nova:user>
Nov 30 10:59:09 user nova-compute[75020]:         <nova:project uuid="0b0cce29854643d0b730dc664697dee7">tempest-AttachVolumeShelveTestJSON-1553674360</nova:project>
Nov 30 10:59:09 user nova-compute[75020]:       </nova:owner>
Nov 30 10:59:09 user nova-compute[75020]:       <nova:root type="image" uuid="e9d179d7-f28f-4ef3-b270-6b032f4a166b"/>
Nov 30 10:59:09 user nova-compute[75020]:       <nova:ports>
Nov 30 10:59:09 user nova-compute[75020]:         <nova:port uuid="aefbdff1-5f9b-4314-9563-07ebbe7a0f48">
Nov 30 10:59:09 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 10:59:09 user nova-compute[75020]:         </nova:port>
Nov 30 10:59:09 user nova-compute[75020]:       </nova:ports>
Nov 30 10:59:09 user nova-compute[75020]:     </nova:instance>
Nov 30 10:59:09 user nova-compute[75020]:   </metadata>
Nov 30 10:59:09 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:59:09 user nova-compute[75020]:     <system>
Nov 30 10:59:09 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:59:09 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:59:09 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:59:09 user nova-compute[75020]:       <entry name="serial">e35772a3-9a06-4ae7-bf6d-e433fee4dee6</entry>
Nov 30 10:59:09 user nova-compute[75020]:       <entry name="uuid">e35772a3-9a06-4ae7-bf6d-e433fee4dee6</entry>
Nov 30 10:59:09 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:59:09 user nova-compute[75020]:     </system>
Nov 30 10:59:09 user nova-compute[75020]:   </sysinfo>
Nov 30 10:59:09 user nova-compute[75020]:   <os>
Nov 30 10:59:09 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:59:09 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:59:09 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:59:09 user nova-compute[75020]:   </os>
Nov 30 10:59:09 user nova-compute[75020]:   <features>
Nov 30 10:59:09 user nova-compute[75020]:     <acpi/>
Nov 30 10:59:09 user nova-compute[75020]:     <apic/>
Nov 30 10:59:09 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:59:09 user nova-compute[75020]:   </features>
Nov 30 10:59:09 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:59:09 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:59:09 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:59:09 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:59:09 user nova-compute[75020]:   </clock>
Nov 30 10:59:09 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:59:09 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:59:09 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:59:09 user nova-compute[75020]:   </cpu>
Nov 30 10:59:09 user nova-compute[75020]:   <devices>
Nov 30 10:59:09 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:59:09 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:59:09 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk"/>
Nov 30 10:59:09 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:59:09 user nova-compute[75020]:     </disk>
Nov 30 10:59:09 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:59:09 user nova-compute[75020]:       <mac address="fa:16:3e:97:bb:1c"/>
Nov 30 10:59:09 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:09 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:59:09 user nova-compute[75020]:       <target dev="tapaefbdff1-5f"/>
Nov 30 10:59:09 user nova-compute[75020]:     </interface>
Nov 30 10:59:09 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:59:09 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/console.log" append="off"/>
Nov 30 10:59:09 user nova-compute[75020]:     </serial>
Nov 30 10:59:09 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:59:09 user nova-compute[75020]:     <video>
Nov 30 10:59:09 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:09 user nova-compute[75020]:     </video>
Nov 30 10:59:09 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:59:09 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:59:09 user nova-compute[75020]:     </rng>
Nov 30 10:59:09 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:59:09 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:59:09 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:59:09 user nova-compute[75020]:     </memballoon>
Nov 30 10:59:09 user nova-compute[75020]:   </devices>
Nov 30 10:59:09 user nova-compute[75020]: </domain>
Nov 30 10:59:09 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109579761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109579761',id=22,image_ref='e9d179d7-f28f-4ef3-b270-6b032f4a166b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1490479026',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-a1bndffv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member',shelved_at='2023-11-30T10:57:16.012532',shelved_host='user',shelved_image_id='e9d179d7-f28f-4ef3-b270-6b032f4a166b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=e35772a3-9a06-4ae7-bf6d-e433fee4dee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG os_vif [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '504be693-6a62-5f38-9a9e-9e5843ebf9a1', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaefbdff1-5f, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaefbdff1-5f, col_values=(('qos', UUID('d8b991ec-b3c4-4c24-a1be-26de5aa426d2')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaefbdff1-5f, col_values=(('external_ids', {'iface-id': 'aefbdff1-5f9b-4314-9563-07ebbe7a0f48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:bb:1c', 'vm-uuid': 'e35772a3-9a06-4ae7-bf6d-e433fee4dee6'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:09 user nova-compute[75020]: INFO os_vif [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f')
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:59:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] No VIF found with MAC fa:16:3e:97:bb:1c, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-8d95707d-50b7-4447-bbc9-9288cfab473c req-75dc0017-1337-4df8-b158-147ee7fc0b8c service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8d95707d-50b7-4447-bbc9-9288cfab473c req-75dc0017-1337-4df8-b158-147ee7fc0b8c service nova] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8d95707d-50b7-4447-bbc9-9288cfab473c req-75dc0017-1337-4df8-b158-147ee7fc0b8c service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8d95707d-50b7-4447-bbc9-9288cfab473c req-75dc0017-1337-4df8-b158-147ee7fc0b8c service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-8d95707d-50b7-4447-bbc9-9288cfab473c req-75dc0017-1337-4df8-b158-147ee7fc0b8c service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] No waiting events found dispatching network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:11 user nova-compute[75020]: WARNING nova.compute.manager [req-8d95707d-50b7-4447-bbc9-9288cfab473c req-75dc0017-1337-4df8-b158-147ee7fc0b8c service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received unexpected event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 10:59:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:59:11 user nova-compute[75020]: INFO nova.compute.manager [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] instance snapshotting
Nov 30 10:59:11 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Beginning live snapshot process
Nov 30 10:59:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json -f qcow2 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json -f qcow2 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdc3bl5rb/08a4d65696a0469b907cd32b5554d63a.delta 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdc3bl5rb/08a4d65696a0469b907cd32b5554d63a.delta 1073741824" returned: 0 in 0.051s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 10:59:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fae5310f-5516-4349-ad31-4df9453171a7 is timed out.
Nov 30 10:59:13 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Successfully detached device vdb from instance fae5310f-5516-4349-ad31-4df9453171a7 from the live domain config.
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvrVBXTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:59:13 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[014a52e0-9789-4278-8864-6bc46e6e1e66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:59:13 user nova-compute[75020]: No targets found.
Nov 30 10:59:13 user nova-compute[75020]: iSNS:
Nov 30 10:59:13 user nova-compute[75020]: No targets found.
Nov 30 10:59:13 user nova-compute[75020]: STATIC:
Nov 30 10:59:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2
Nov 30 10:59:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:59:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:59:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426
Nov 30 10:59:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:59:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:59:13 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:59:13 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:59:13 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:59:13 user nova-compute[75020]: FIRMWARE:
Nov 30 10:59:13 user nova-compute[75020]: No targets found.
Nov 30 10:59:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:59:13 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:59:13 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2c746a-e324-4966-9dc8-a1d487470661]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd5810-67d9-4f82-974c-cf235660aeed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:13 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:59:13 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:13 user nova-compute[75020]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 (non-flash)
Nov 30 10:59:13 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad887d56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62916e-2699-4b0c-852d-ac05e49e9457]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270fc06-9b92-4f6b-9eb9-dfff19da327b]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f950f8-9915-444c-9528-a831b43cefa2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2fa297-8329-4edb-8472-21d6651e28e2]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34c95c0-c605-4fdc-ba1a-eb58807bb77c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c246fa93-f33a-4eb7-b392-760073c0059a]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426, portal: 172.16.0.220,3260]
Nov 30 10:59:13 user nova-compute[75020]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426, portal: 172.16.0.220,3260] successful.
Nov 30 10:59:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:13 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance spawned successfully.
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17ca01e2-09ad-4a33-9d6c-412dc3748426 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd97304-289a-4e17-b1fc-0f0452e9df74]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] <== disconnect_volume: return (330ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-3c3b0e26-c7d3-4834-a361-4ed898117178 req-b6543cf5-b1a8-4d5c-a952-77317961221d service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3c3b0e26-c7d3-4834-a361-4ed898117178 req-b6543cf5-b1a8-4d5c-a952-77317961221d service nova] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3c3b0e26-c7d3-4834-a361-4ed898117178 req-b6543cf5-b1a8-4d5c-a952-77317961221d service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3c3b0e26-c7d3-4834-a361-4ed898117178 req-b6543cf5-b1a8-4d5c-a952-77317961221d service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-3c3b0e26-c7d3-4834-a361-4ed898117178 req-b6543cf5-b1a8-4d5c-a952-77317961221d service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] No waiting events found dispatching network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:13 user nova-compute[75020]: WARNING nova.compute.manager [req-3c3b0e26-c7d3-4834-a361-4ed898117178 req-b6543cf5-b1a8-4d5c-a952-77317961221d service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received unexpected event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-39590b2e-3e99-4f6d-a3a7-51ddabcd408e tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.394s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75020) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 10:59:13 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 10:59:14 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:59:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdc3bl5rb/08a4d65696a0469b907cd32b5554d63a.delta /opt/stack/data/nova/instances/snapshots/tmpdc3bl5rb/08a4d65696a0469b907cd32b5554d63a {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:14 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'flavor' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b50d6a4c-19c7-4987-8dc9-a38b46b39ff4 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.839s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdc3bl5rb/08a4d65696a0469b907cd32b5554d63a.delta /opt/stack/data/nova/instances/snapshots/tmpdc3bl5rb/08a4d65696a0469b907cd32b5554d63a" returned: 0 in 0.265s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Snapshot extracted, beginning image upload
Nov 30 10:59:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Snapshot image upload complete
Nov 30 10:59:16 user nova-compute[75020]: INFO nova.compute.manager [None req-148941c7-6576-4cc7-8089-fe634b805931 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Took 5.08 seconds to snapshot the instance on the hypervisor.
Nov 30 10:59:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "492f3123-e679-4a6c-a134-6c7912054463" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:59:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:17 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:59:17 user nova-compute[75020]: INFO nova.compute.claims [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Claim successful on node user
Nov 30 10:59:18 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:59:18 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:59:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:59:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:59:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:59:18 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:59:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:59:18 user nova-compute[75020]: DEBUG nova.policy [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a93ae25dec664c44ba88b0f15f6a239e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02acda28c914dcdaa8afa65411b8055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:59:18 user nova-compute[75020]: INFO nova.virt.block_device [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Booting with volume-backed-image a0e347bf-fa3a-4008-b934-b96aa4570396 at /dev/vda
Nov 30 10:59:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:59:19 user nova-compute[75020]: INFO nova.compute.claims [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Claim successful on node user
Nov 30 10:59:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Successfully created port: 5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:59:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:59:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG nova.policy [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f7cebdc6c934eaa97be8559abb908c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d999c2680894b4da64f0225c6bcdd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:59:20 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Creating image(s)
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "/opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "/opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "/opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "f1c659afb5f3772c43bd163bdac91c7671453bf0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "f1c659afb5f3772c43bd163bdac91c7671453bf0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Successfully updated port: 5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-6222027c-39f0-4202-b7d7-6acd2f65c38f req-d43a776e-a5d6-4fb2-8df7-6cc288ce86d4 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-changed-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-6222027c-39f0-4202-b7d7-6acd2f65c38f req-d43a776e-a5d6-4fb2-8df7-6cc288ce86d4 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Refreshing instance network info cache due to event network-changed-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6222027c-39f0-4202-b7d7-6acd2f65c38f req-d43a776e-a5d6-4fb2-8df7-6cc288ce86d4 service nova] Acquiring lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6222027c-39f0-4202-b7d7-6acd2f65c38f req-d43a776e-a5d6-4fb2-8df7-6cc288ce86d4 service nova] Acquired lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-6222027c-39f0-4202-b7d7-6acd2f65c38f req-d43a776e-a5d6-4fb2-8df7-6cc288ce86d4 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Refreshing network info cache for port 5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:59:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG nova.network.neutron [req-6222027c-39f0-4202-b7d7-6acd2f65c38f req-d43a776e-a5d6-4fb2-8df7-6cc288ce86d4 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0.part --force-share --output=json" returned: 0 in 0.201s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG nova.virt.images [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] 6e2901b4-d244-4b41-a4d7-ebf1bbab999b was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0.part /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0.part /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0.converted" returned: 0 in 0.164s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG nova.network.neutron [req-6222027c-39f0-4202-b7d7-6acd2f65c38f req-d43a776e-a5d6-4fb2-8df7-6cc288ce86d4 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6222027c-39f0-4202-b7d7-6acd2f65c38f req-d43a776e-a5d6-4fb2-8df7-6cc288ce86d4 service nova] Releasing lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquired lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "f1c659afb5f3772c43bd163bdac91c7671453bf0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.457s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0 --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "f1c659afb5f3772c43bd163bdac91c7671453bf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "f1c659afb5f3772c43bd163bdac91c7671453bf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Successfully created port: bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0,backing_fmt=raw /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0,backing_fmt=raw /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk 1073741824" returned: 0 in 0.058s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "f1c659afb5f3772c43bd163bdac91c7671453bf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Updating instance_info_cache with network_info: [{"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Releasing lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance network_info: |[{"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0 --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Ensure instance console log exists: /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Successfully updated port: bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquired lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-2d79c452-d52b-4ef9-ac08-0ab1a0eb0c85 req-a5bf36da-f53d-4eb3-919e-514f79683811 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received event network-changed-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-2d79c452-d52b-4ef9-ac08-0ab1a0eb0c85 req-a5bf36da-f53d-4eb3-919e-514f79683811 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Refreshing instance network info cache due to event network-changed-bf1932cd-f17b-44b7-ac71-ac89f2031f0d. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d79c452-d52b-4ef9-ac08-0ab1a0eb0c85 req-a5bf36da-f53d-4eb3-919e-514f79683811 service nova] Acquiring lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updating instance_info_cache with network_info: [{"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Releasing lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Instance network_info: |[{"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d79c452-d52b-4ef9-ac08-0ab1a0eb0c85 req-a5bf36da-f53d-4eb3-919e-514f79683811 service nova] Acquired lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-2d79c452-d52b-4ef9-ac08-0ab1a0eb0c85 req-a5bf36da-f53d-4eb3-919e-514f79683811 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Refreshing network info cache for port bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Start _get_guest_xml network_info=[{"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ccedbd1d6689b28c2a67510bbe08faf7',container_format='bare',created_at=2023-11-30T10:59:12Z,direct_url=<?>,disk_format='qcow2',id=6e2901b4-d244-4b41-a4d7-ebf1bbab999b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-189141214',owner='0d999c2680894b4da64f0225c6bcdd21',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T10:59:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': '6e2901b4-d244-4b41-a4d7-ebf1bbab999b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:59:22 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:22 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ccedbd1d6689b28c2a67510bbe08faf7',container_format='bare',created_at=2023-11-30T10:59:12Z,direct_url=<?>,disk_format='qcow2',id=6e2901b4-d244-4b41-a4d7-ebf1bbab999b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-189141214',owner='0d999c2680894b4da64f0225c6bcdd21',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T10:59:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-932943961',display_name='tempest-TestStampPattern-server-932943961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-932943961',id=28,image_ref='6e2901b4-d244-4b41-a4d7-ebf1bbab999b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8UuvcChSK6YskalIYpxvBcattqsFAEkXGidi6+8eqZCgj0JoQFKkJY54GUIo9V7Y2I7TNjEyC4R61MG4WaGSwKn4DJq095MqcrSgDLeoxMdOBD3ZIwKqXIZYjQCzQP2A==',key_name='tempest-TestStampPattern-1231142888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d999c2680894b4da64f0225c6bcdd21',ramdisk_id='',reservation_id='r-mum0ofv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='875f4516-89d8-432e-aaee-840162613ba1',image_min_disk='1',image_min_ram='0',image_owner_id='0d999c2680894b4da64f0225c6bcdd21',image_owner_project_name='tempest-TestStampPattern-978441576',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-978441576-project-member',image_user_id='4f7cebdc6c934eaa97be8559abb908c3',network_allocated='True',owner_project_name='tempest-TestStampPattern-978441576',owner_user_name='tempest-TestStampPattern-978441576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:20Z,user_data=None,user_id='4f7cebdc6c934eaa97be8559abb908c3',uuid=e135a295-5025-4013-bb21-634a2837f0d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converting VIF {"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=bf1932cd-f17b-44b7-ac71-ac89f2031f0d,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1932cd-f1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'pci_devices' on Instance uuid e135a295-5025-4013-bb21-634a2837f0d8 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:59:22 user nova-compute[75020]:   <uuid>e135a295-5025-4013-bb21-634a2837f0d8</uuid>
Nov 30 10:59:22 user nova-compute[75020]:   <name>instance-0000001c</name>
Nov 30 10:59:22 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:59:22 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:59:22 user nova-compute[75020]:   <metadata>
Nov 30 10:59:22 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:59:22 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:59:22 user nova-compute[75020]:       <nova:name>tempest-TestStampPattern-server-932943961</nova:name>
Nov 30 10:59:22 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:59:22</nova:creationTime>
Nov 30 10:59:22 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:59:22 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:59:22 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:59:22 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:59:22 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:59:22 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:59:22 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:59:22 user nova-compute[75020]:       <nova:owner>
Nov 30 10:59:22 user nova-compute[75020]:         <nova:user uuid="4f7cebdc6c934eaa97be8559abb908c3">tempest-TestStampPattern-978441576-project-member</nova:user>
Nov 30 10:59:22 user nova-compute[75020]:         <nova:project uuid="0d999c2680894b4da64f0225c6bcdd21">tempest-TestStampPattern-978441576</nova:project>
Nov 30 10:59:22 user nova-compute[75020]:       </nova:owner>
Nov 30 10:59:22 user nova-compute[75020]:       <nova:root type="image" uuid="6e2901b4-d244-4b41-a4d7-ebf1bbab999b"/>
Nov 30 10:59:22 user nova-compute[75020]:       <nova:ports>
Nov 30 10:59:22 user nova-compute[75020]:         <nova:port uuid="bf1932cd-f17b-44b7-ac71-ac89f2031f0d">
Nov 30 10:59:22 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 10:59:22 user nova-compute[75020]:         </nova:port>
Nov 30 10:59:22 user nova-compute[75020]:       </nova:ports>
Nov 30 10:59:22 user nova-compute[75020]:     </nova:instance>
Nov 30 10:59:22 user nova-compute[75020]:   </metadata>
Nov 30 10:59:22 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:59:22 user nova-compute[75020]:     <system>
Nov 30 10:59:22 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:59:22 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:59:22 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:59:22 user nova-compute[75020]:       <entry name="serial">e135a295-5025-4013-bb21-634a2837f0d8</entry>
Nov 30 10:59:22 user nova-compute[75020]:       <entry name="uuid">e135a295-5025-4013-bb21-634a2837f0d8</entry>
Nov 30 10:59:22 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:59:22 user nova-compute[75020]:     </system>
Nov 30 10:59:22 user nova-compute[75020]:   </sysinfo>
Nov 30 10:59:22 user nova-compute[75020]:   <os>
Nov 30 10:59:22 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:59:22 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:59:22 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:59:22 user nova-compute[75020]:   </os>
Nov 30 10:59:22 user nova-compute[75020]:   <features>
Nov 30 10:59:22 user nova-compute[75020]:     <acpi/>
Nov 30 10:59:22 user nova-compute[75020]:     <apic/>
Nov 30 10:59:22 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:59:22 user nova-compute[75020]:   </features>
Nov 30 10:59:22 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:59:22 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:59:22 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:59:22 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:59:22 user nova-compute[75020]:   </clock>
Nov 30 10:59:22 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:59:22 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:59:22 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:59:22 user nova-compute[75020]:   </cpu>
Nov 30 10:59:22 user nova-compute[75020]:   <devices>
Nov 30 10:59:22 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:59:22 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:59:22 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk"/>
Nov 30 10:59:22 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:59:22 user nova-compute[75020]:     </disk>
Nov 30 10:59:22 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:59:22 user nova-compute[75020]:       <mac address="fa:16:3e:f1:b0:c5"/>
Nov 30 10:59:22 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:22 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:59:22 user nova-compute[75020]:       <target dev="tapbf1932cd-f1"/>
Nov 30 10:59:22 user nova-compute[75020]:     </interface>
Nov 30 10:59:22 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:59:22 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/console.log" append="off"/>
Nov 30 10:59:22 user nova-compute[75020]:     </serial>
Nov 30 10:59:22 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:59:22 user nova-compute[75020]:     <video>
Nov 30 10:59:22 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:22 user nova-compute[75020]:     </video>
Nov 30 10:59:22 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:59:22 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:59:22 user nova-compute[75020]:     </rng>
Nov 30 10:59:22 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:59:22 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:59:22 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:59:22 user nova-compute[75020]:     </memballoon>
Nov 30 10:59:22 user nova-compute[75020]:   </devices>
Nov 30 10:59:22 user nova-compute[75020]: </domain>
Nov 30 10:59:22 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-932943961',display_name='tempest-TestStampPattern-server-932943961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-932943961',id=28,image_ref='6e2901b4-d244-4b41-a4d7-ebf1bbab999b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8UuvcChSK6YskalIYpxvBcattqsFAEkXGidi6+8eqZCgj0JoQFKkJY54GUIo9V7Y2I7TNjEyC4R61MG4WaGSwKn4DJq095MqcrSgDLeoxMdOBD3ZIwKqXIZYjQCzQP2A==',key_name='tempest-TestStampPattern-1231142888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d999c2680894b4da64f0225c6bcdd21',ramdisk_id='',reservation_id='r-mum0ofv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='875f4516-89d8-432e-aaee-840162613ba1',image_min_disk='1',image_min_ram='0',image_owner_id='0d999c2680894b4da64f0225c6bcdd21',image_owner_project_name='tempest-TestStampPattern-978441576',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-978441576-project-member',image_user_id='4f7cebdc6c934eaa97be8559abb908c3',network_allocated='True',owner_project_name='tempest-TestStampPattern-978441576',owner_user_name='tempest-TestStampPattern-978441576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:20Z,user_data=None,user_id='4f7cebdc6c934eaa97be8559abb908c3',uuid=e135a295-5025-4013-bb21-634a2837f0d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converting VIF {"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=bf1932cd-f17b-44b7-ac71-ac89f2031f0d,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1932cd-f1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG os_vif [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=bf1932cd-f17b-44b7-ac71-ac89f2031f0d,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1932cd-f1') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43676c26-436b-5cd8-a8ef-c6059fa3fc4f', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf1932cd-f1, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf1932cd-f1, col_values=(('qos', UUID('253dbd4e-4475-40e2-ab3d-38a546500262')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf1932cd-f1, col_values=(('external_ids', {'iface-id': 'bf1932cd-f17b-44b7-ac71-ac89f2031f0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:b0:c5', 'vm-uuid': 'e135a295-5025-4013-bb21-634a2837f0d8'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:22 user nova-compute[75020]: INFO os_vif [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=bf1932cd-f17b-44b7-ac71-ac89f2031f0d,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1932cd-f1')
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:59:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No VIF found with MAC fa:16:3e:f1:b0:c5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:59:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-2d79c452-d52b-4ef9-ac08-0ab1a0eb0c85 req-a5bf36da-f53d-4eb3-919e-514f79683811 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updated VIF entry in instance network info cache for port bf1932cd-f17b-44b7-ac71-ac89f2031f0d. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:59:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-2d79c452-d52b-4ef9-ac08-0ab1a0eb0c85 req-a5bf36da-f53d-4eb3-919e-514f79683811 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updating instance_info_cache with network_info: [{"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d79c452-d52b-4ef9-ac08-0ab1a0eb0c85 req-a5bf36da-f53d-4eb3-919e-514f79683811 service nova] Releasing lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-64a66a74-8bb1-41a0-9c59-90702d07383f req-64ee8e48-7fc1-4a39-9ac8-95556c3a5865 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received event network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64a66a74-8bb1-41a0-9c59-90702d07383f req-64ee8e48-7fc1-4a39-9ac8-95556c3a5865 service nova] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64a66a74-8bb1-41a0-9c59-90702d07383f req-64ee8e48-7fc1-4a39-9ac8-95556c3a5865 service nova] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64a66a74-8bb1-41a0-9c59-90702d07383f req-64ee8e48-7fc1-4a39-9ac8-95556c3a5865 service nova] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-64a66a74-8bb1-41a0-9c59-90702d07383f req-64ee8e48-7fc1-4a39-9ac8-95556c3a5865 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] No waiting events found dispatching network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:24 user nova-compute[75020]: WARNING nova.compute.manager [req-64a66a74-8bb1-41a0-9c59-90702d07383f req-64ee8e48-7fc1-4a39-9ac8-95556c3a5865 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received unexpected event network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d for instance with vm_state building and task_state spawning.
Nov 30 10:59:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:25 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 10:59:26 user nova-compute[75020]: INFO nova.compute.claims [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Claim successful on node user
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:59:26 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Instance spawned successfully.
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.compute.manager [req-98ddc663-b82e-4b43-92a9-9bf24b51a287 req-8f92b575-33b4-4f37-9274-dbf6adcb82bc service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received event network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-98ddc663-b82e-4b43-92a9-9bf24b51a287 req-8f92b575-33b4-4f37-9274-dbf6adcb82bc service nova] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-98ddc663-b82e-4b43-92a9-9bf24b51a287 req-8f92b575-33b4-4f37-9274-dbf6adcb82bc service nova] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-98ddc663-b82e-4b43-92a9-9bf24b51a287 req-8f92b575-33b4-4f37-9274-dbf6adcb82bc service nova] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.compute.manager [req-98ddc663-b82e-4b43-92a9-9bf24b51a287 req-8f92b575-33b4-4f37-9274-dbf6adcb82bc service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] No waiting events found dispatching network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:26 user nova-compute[75020]: WARNING nova.compute.manager [req-98ddc663-b82e-4b43-92a9-9bf24b51a287 req-8f92b575-33b4-4f37-9274-dbf6adcb82bc service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received unexpected event network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d for instance with vm_state building and task_state spawning.
Nov 30 10:59:26 user nova-compute[75020]: INFO nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Took 6.67 seconds to spawn the instance on the hypervisor.
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.network.neutron [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 10:59:26 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 10:59:26 user nova-compute[75020]: INFO nova.compute.manager [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Took 7.68 seconds to build instance.
Nov 30 10:59:26 user nova-compute[75020]: DEBUG nova.policy [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f64ef255b2a48349a280bf3693af23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10919b523b740859f3ac98e31468a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a170d9aa-61d6-443a-b5f1-23014a8386d5 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.791s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:26 user nova-compute[75020]: INFO nova.virt.block_device [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Booting with volume 948eb37d-9bff-42a3-92a5-0a1c41198ead at /dev/vda
Nov 30 10:59:26 user nova-compute[75020]: DEBUG os_brick.utils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b06b8b-1811-49e6-b0f7-c19273749d5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfe17bb-ae82-455b-a80d-42a77ac78ab4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.073s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de7da9a-56fa-40b8-b01d-6c28f3434aba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54a5f53-02ff-48a1-b94c-f4454eb9427f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:59:27 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:59:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[068d53c1-6ece-486f-9720-7c652d325ca0]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG os_brick.utils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:59:27 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating existing volume attachment record: 1b8927ba-3147-40cc-a8c4-ea25db31712d {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG nova.network.neutron [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Successfully created port: fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG nova.network.neutron [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Successfully updated port: fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquired lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG nova.network.neutron [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-cca185a7-75c9-4c23-a01f-44ea6ec110e4 req-508f966d-d950-450d-8817-6ffd0518b1af service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-changed-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-cca185a7-75c9-4c23-a01f-44ea6ec110e4 req-508f966d-d950-450d-8817-6ffd0518b1af service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Refreshing instance network info cache due to event network-changed-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cca185a7-75c9-4c23-a01f-44ea6ec110e4 req-508f966d-d950-450d-8817-6ffd0518b1af service nova] Acquiring lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:28 user nova-compute[75020]: DEBUG nova.network.neutron [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG nova.network.neutron [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating instance_info_cache with network_info: [{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Releasing lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance network_info: |[{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cca185a7-75c9-4c23-a01f-44ea6ec110e4 req-508f966d-d950-450d-8817-6ffd0518b1af service nova] Acquired lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG nova.network.neutron [req-cca185a7-75c9-4c23-a01f-44ea6ec110e4 req-508f966d-d950-450d-8817-6ffd0518b1af service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Refreshing network info cache for port fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG nova.network.neutron [req-cca185a7-75c9-4c23-a01f-44ea6ec110e4 req-508f966d-d950-450d-8817-6ffd0518b1af service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updated VIF entry in instance network info cache for port fd39b8a9-8223-43c9-9fa3-9b4bc9461edf. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG nova.network.neutron [req-cca185a7-75c9-4c23-a01f-44ea6ec110e4 req-508f966d-d950-450d-8817-6ffd0518b1af service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating instance_info_cache with network_info: [{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cca185a7-75c9-4c23-a01f-44ea6ec110e4 req-508f966d-d950-450d-8817-6ffd0518b1af service nova] Releasing lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG os_brick.utils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac8b555-38f0-42a5-84c1-5fb983232165]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae6410-92aa-4d7d-bb1d-c2782ba1fa16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[515b9f35-8384-497e-a57e-a5e3bcec5f95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[33886ddb-c51c-4d9b-bd6d-b73545ac8a94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 10:59:29 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 10:59:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f27bc0-3e2c-4e45-8da3-697cd82819bd]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG os_brick.utils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:59:29 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Updating existing volume attachment record: d7537c87-dcd3-41d1-89f9-fbdd5af9d8da {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 10:59:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:59:36 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Creating image(s)
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Ensure instance console log exists: /opt/stack/data/nova/instances/79fe1d49-08c7-4197-a6b6-7f7dc4500487/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Start _get_guest_xml network_info=[{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1b8927ba-3147-40cc-a8c4-ea25db31712d', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVAphqHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '79fe1d49-08c7-4197-a6b6-7f7dc4500487', 'attached_at': '', 'detached_at': '', 'volume_id': '948eb37d-9bff-42a3-92a5-0a1c41198ead', 'serial': '948eb37d-9bff-42a3-92a5-0a1c41198ead'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:59:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVAphqHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:59:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:59:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:59:36 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[29123090-c25d-4197-88eb-41f05517d1aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:59:36 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7a435-dea7-4f26-a048-22b123f6f26c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead] added
Nov 30 10:59:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9c1008-ba53-4083-9158-9175d0de4497]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d49b80-c470-43d5-b6ff-f532b50e7bf7]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVAphqHn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVAphqHn" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[643990b9-8815-4147-9944-057cdb7003f9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVAphqHn'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b40a3fc-099d-4fc1-9692-ce359f4415fb]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe3865c-5ac4-46ca-87f0-5874fa50d4a4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:36 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:36 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b84878-d9cb-4777-bab4-d3ab07dc6289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260]
Nov 30 10:59:36 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260] successful.
Nov 30 10:59:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bda811-37fb-4acf-8c0d-791a0c1fe2fb]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca674a2-151a-4888-b632-93b564d42769]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:36 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:36 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 10:59:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:36 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:36 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 10:59:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd59446-82d3-4652-a625-b02f1138e654]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:59:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVAphqHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23733336239666132', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733336239666132', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092003400',display_name='tempest-ServerActionsTestOtherA-server-1092003400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092003400',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-m0a6tv5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=79fe1d49-08c7-4197-a6b6-7f7dc4500487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'pci_devices' on Instance uuid 79fe1d49-08c7-4197-a6b6-7f7dc4500487 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:59:37 user nova-compute[75020]:   <uuid>79fe1d49-08c7-4197-a6b6-7f7dc4500487</uuid>
Nov 30 10:59:37 user nova-compute[75020]:   <name>instance-0000001d</name>
Nov 30 10:59:37 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:59:37 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:59:37 user nova-compute[75020]:   <metadata>
Nov 30 10:59:37 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:59:37 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:59:37 user nova-compute[75020]:       <nova:name>tempest-ServerActionsTestOtherA-server-1092003400</nova:name>
Nov 30 10:59:37 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:59:36</nova:creationTime>
Nov 30 10:59:37 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:59:37 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:59:37 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:59:37 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:59:37 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:59:37 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:59:37 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:59:37 user nova-compute[75020]:       <nova:owner>
Nov 30 10:59:37 user nova-compute[75020]:         <nova:user uuid="7f64ef255b2a48349a280bf3693af23f">tempest-ServerActionsTestOtherA-582760806-project-member</nova:user>
Nov 30 10:59:37 user nova-compute[75020]:         <nova:project uuid="e10919b523b740859f3ac98e31468a93">tempest-ServerActionsTestOtherA-582760806</nova:project>
Nov 30 10:59:37 user nova-compute[75020]:       </nova:owner>
Nov 30 10:59:37 user nova-compute[75020]:       <nova:ports>
Nov 30 10:59:37 user nova-compute[75020]:         <nova:port uuid="fd39b8a9-8223-43c9-9fa3-9b4bc9461edf">
Nov 30 10:59:37 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 10:59:37 user nova-compute[75020]:         </nova:port>
Nov 30 10:59:37 user nova-compute[75020]:       </nova:ports>
Nov 30 10:59:37 user nova-compute[75020]:     </nova:instance>
Nov 30 10:59:37 user nova-compute[75020]:   </metadata>
Nov 30 10:59:37 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:59:37 user nova-compute[75020]:     <system>
Nov 30 10:59:37 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:59:37 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:59:37 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:59:37 user nova-compute[75020]:       <entry name="serial">79fe1d49-08c7-4197-a6b6-7f7dc4500487</entry>
Nov 30 10:59:37 user nova-compute[75020]:       <entry name="uuid">79fe1d49-08c7-4197-a6b6-7f7dc4500487</entry>
Nov 30 10:59:37 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:59:37 user nova-compute[75020]:     </system>
Nov 30 10:59:37 user nova-compute[75020]:   </sysinfo>
Nov 30 10:59:37 user nova-compute[75020]:   <os>
Nov 30 10:59:37 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:59:37 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:59:37 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:59:37 user nova-compute[75020]:   </os>
Nov 30 10:59:37 user nova-compute[75020]:   <features>
Nov 30 10:59:37 user nova-compute[75020]:     <acpi/>
Nov 30 10:59:37 user nova-compute[75020]:     <apic/>
Nov 30 10:59:37 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:59:37 user nova-compute[75020]:   </features>
Nov 30 10:59:37 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:59:37 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:59:37 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:59:37 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:59:37 user nova-compute[75020]:   </clock>
Nov 30 10:59:37 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:59:37 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:59:37 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:59:37 user nova-compute[75020]:   </cpu>
Nov 30 10:59:37 user nova-compute[75020]:   <devices>
Nov 30 10:59:37 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:59:37 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:59:37 user nova-compute[75020]:       <source dev="/dev/sdc"/>
Nov 30 10:59:37 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:59:37 user nova-compute[75020]:       <serial>948eb37d-9bff-42a3-92a5-0a1c41198ead</serial>
Nov 30 10:59:37 user nova-compute[75020]:     </disk>
Nov 30 10:59:37 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:59:37 user nova-compute[75020]:       <mac address="fa:16:3e:fa:03:52"/>
Nov 30 10:59:37 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:37 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:59:37 user nova-compute[75020]:       <target dev="tapfd39b8a9-82"/>
Nov 30 10:59:37 user nova-compute[75020]:     </interface>
Nov 30 10:59:37 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:59:37 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/79fe1d49-08c7-4197-a6b6-7f7dc4500487/console.log" append="off"/>
Nov 30 10:59:37 user nova-compute[75020]:     </serial>
Nov 30 10:59:37 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:59:37 user nova-compute[75020]:     <video>
Nov 30 10:59:37 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:37 user nova-compute[75020]:     </video>
Nov 30 10:59:37 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:59:37 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:59:37 user nova-compute[75020]:     </rng>
Nov 30 10:59:37 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:59:37 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:59:37 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:59:37 user nova-compute[75020]:     </memballoon>
Nov 30 10:59:37 user nova-compute[75020]:   </devices>
Nov 30 10:59:37 user nova-compute[75020]: </domain>
Nov 30 10:59:37 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092003400',display_name='tempest-ServerActionsTestOtherA-server-1092003400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092003400',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-m0a6tv5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=79fe1d49-08c7-4197-a6b6-7f7dc4500487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG os_vif [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4755606b-61b8-5f9f-957d-fb8ac1529008', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd39b8a9-82, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd39b8a9-82, col_values=(('qos', UUID('c7563f04-83be-4442-a5f2-3b479211fbf1')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd39b8a9-82, col_values=(('external_ids', {'iface-id': 'fd39b8a9-8223-43c9-9fa3-9b4bc9461edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:03:52', 'vm-uuid': '79fe1d49-08c7-4197-a6b6-7f7dc4500487'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:37 user nova-compute[75020]: INFO os_vif [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82')
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:59:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No VIF found with MAC fa:16:3e:fa:03:52, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:59:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.038s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:39 user nova-compute[75020]: INFO nova.compute.manager [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Terminating instance
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-efd8fff7-bc38-4a62-a123-7dac50180dbc req-7cfa918e-3a86-4897-adcb-10fbb5bcb344 service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received event network-vif-unplugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-efd8fff7-bc38-4a62-a123-7dac50180dbc req-7cfa918e-3a86-4897-adcb-10fbb5bcb344 service nova] Acquiring lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-efd8fff7-bc38-4a62-a123-7dac50180dbc req-7cfa918e-3a86-4897-adcb-10fbb5bcb344 service nova] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-efd8fff7-bc38-4a62-a123-7dac50180dbc req-7cfa918e-3a86-4897-adcb-10fbb5bcb344 service nova] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-efd8fff7-bc38-4a62-a123-7dac50180dbc req-7cfa918e-3a86-4897-adcb-10fbb5bcb344 service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] No waiting events found dispatching network-vif-unplugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-efd8fff7-bc38-4a62-a123-7dac50180dbc req-7cfa918e-3a86-4897-adcb-10fbb5bcb344 service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received event network-vif-unplugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-d55e8a52-c3c7-4ee8-81e1-31dbb9c75211 req-d97597cc-5e15-4be7-9f78-3b0216e0710f service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d55e8a52-c3c7-4ee8-81e1-31dbb9c75211 req-d97597cc-5e15-4be7-9f78-3b0216e0710f service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d55e8a52-c3c7-4ee8-81e1-31dbb9c75211 req-d97597cc-5e15-4be7-9f78-3b0216e0710f service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d55e8a52-c3c7-4ee8-81e1-31dbb9c75211 req-d97597cc-5e15-4be7-9f78-3b0216e0710f service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-d55e8a52-c3c7-4ee8-81e1-31dbb9c75211 req-d97597cc-5e15-4be7-9f78-3b0216e0710f service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:39 user nova-compute[75020]: WARNING nova.compute.manager [req-d55e8a52-c3c7-4ee8-81e1-31dbb9c75211 req-d97597cc-5e15-4be7-9f78-3b0216e0710f service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state building and task_state spawning.
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 10:59:39 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Creating image(s)
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Ensure instance console log exists: /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Start _get_guest_xml network_info=[{"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'd7537c87-dcd3-41d1-89f9-fbdd5af9d8da', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtHYEywf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '492f3123-e679-4a6c-a134-6c7912054463', 'attached_at': '', 'detached_at': '', 'volume_id': 'b258d561-61a3-4f4a-8731-f7bf0f714e15', 'serial': 'b258d561-61a3-4f4a-8731-f7bf0f714e15'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:39 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtHYEywf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:59:39 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:59:39 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:59:39 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b418dc-b0a5-46bd-8c48-7bfc88e3f007]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 10:59:39 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bf37a9-7759-4364-9fe5-fc9bd785a5a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15] added
Nov 30 10:59:39 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e13fd-be8c-4cf3-ba97-cbb2d456a8d1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8814b43-c969-451d-b591-69211c799965]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtHYEywf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:39 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Instance destroyed successfully.
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'resources' on Instance uuid b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtHYEywf" returned: 0 in 0.030s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224eda1-4439-4dfc-b92f-764ef2c08fb5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-126354465',display_name='tempest-TestVolumeBootPattern-server-126354465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-126354465',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:58:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-2gn0ztwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:58:19Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "address": "fa:16:3e:86:e1:1f", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ac1e82-69", "ovs_interfaceid": "69ac1e82-691b-456a-bf81-65a2a0aaadb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e1:1f,bridge_name='br-int',has_traffic_filtering=True,id=69ac1e82-691b-456a-bf81-65a2a0aaadb9,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ac1e82-69') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_vif [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e1:1f,bridge_name='br-int',has_traffic_filtering=True,id=69ac1e82-691b-456a-bf81-65a2a0aaadb9,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ac1e82-69') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VtHYEywf'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69ac1e82-69, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fea5582-c83a-4ed7-bec3-d5f8955140e5) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:39 user nova-compute[75020]: INFO os_vif [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e1:1f,bridge_name='br-int',has_traffic_filtering=True,id=69ac1e82-691b-456a-bf81-65a2a0aaadb9,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ac1e82-69')
Nov 30 10:59:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqJiLwFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 10:59:39 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dcfedd-11a6-46b8-a42b-5c3dd45a1978]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[641b6ae1-4179-45ff-80e0-29e4aeb7ae09]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:39 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:39 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 10:59:39 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:39 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:39 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 10:59:39 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:59:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e6136f-877e-48ce-92e9-126c34fc574e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15, portal: 172.16.0.220,3260]
Nov 30 10:59:40 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15, portal: 172.16.0.220,3260] successful.
Nov 30 10:59:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0829c6d-6500-4d6f-9311-1a6a7eccce72]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b206a0d6-a3a6-44ff-8a83-624cbc873f95]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:40 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:40 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 10:59:40 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 10:59:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:40 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:40 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 10:59:40 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 10:59:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee26c27-edaa-447f-af71-dbbbee5a715e]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 10:59:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtHYEywf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23863646337333437', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863646337333437', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.248s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e552da87-83d4-42e3-9453-6fdbc1cb4157]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 10:59:41 user nova-compute[75020]: No targets found.
Nov 30 10:59:41 user nova-compute[75020]: iSNS:
Nov 30 10:59:41 user nova-compute[75020]: No targets found.
Nov 30 10:59:41 user nova-compute[75020]: STATIC:
Nov 30 10:59:41 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2
Nov 30 10:59:41 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:59:41 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:59:41 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead
Nov 30 10:59:41 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:59:41 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:59:41 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15
Nov 30 10:59:41 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:59:41 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:59:41 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 10:59:41 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 10:59:41 user nova-compute[75020]:                 Iface Name: default
Nov 30 10:59:41 user nova-compute[75020]: FIRMWARE:
Nov 30 10:59:41 user nova-compute[75020]: No targets found.
Nov 30 10:59:41 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 10:59:41 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 10:59:41 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-745636477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-745636477',id=27,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-cttz0m7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:19Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=492f3123-e679-4a6c-a134-6c7912054463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:99:3d,bridge_name='br-int',has_traffic_filtering=True,id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c71a3-cf') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'pci_devices' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cda71a-b46e-4de7-9d06-78ffaa9ef1e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59bffb3-f6f7-454a-aadb-fb24ce18141b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:41 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:41 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 10:59:41 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 10:59:41 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 10:59:41 user nova-compute[75020]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 (non-flash)
Nov 30 10:59:41 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 10:59:41 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 10:59:41 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada85fecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:59:41 user nova-compute[75020]:   <uuid>492f3123-e679-4a6c-a134-6c7912054463</uuid>
Nov 30 10:59:41 user nova-compute[75020]:   <name>instance-0000001b</name>
Nov 30 10:59:41 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:59:41 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:59:41 user nova-compute[75020]:   <metadata>
Nov 30 10:59:41 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:59:41 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:59:41 user nova-compute[75020]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-745636477</nova:name>
Nov 30 10:59:41 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:59:39</nova:creationTime>
Nov 30 10:59:41 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:59:41 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:59:41 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:59:41 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:59:41 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:59:41 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:59:41 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:59:41 user nova-compute[75020]:       <nova:owner>
Nov 30 10:59:41 user nova-compute[75020]:         <nova:user uuid="a93ae25dec664c44ba88b0f15f6a239e">tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member</nova:user>
Nov 30 10:59:41 user nova-compute[75020]:         <nova:project uuid="e02acda28c914dcdaa8afa65411b8055">tempest-ServerBootFromVolumeStableRescueTest-548019548</nova:project>
Nov 30 10:59:41 user nova-compute[75020]:       </nova:owner>
Nov 30 10:59:41 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:59:41 user nova-compute[75020]:       <nova:ports>
Nov 30 10:59:41 user nova-compute[75020]:         <nova:port uuid="5f3c71a3-cf0b-4895-a021-ef8d3969b3b0">
Nov 30 10:59:41 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 10:59:41 user nova-compute[75020]:         </nova:port>
Nov 30 10:59:41 user nova-compute[75020]:       </nova:ports>
Nov 30 10:59:41 user nova-compute[75020]:     </nova:instance>
Nov 30 10:59:41 user nova-compute[75020]:   </metadata>
Nov 30 10:59:41 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:59:41 user nova-compute[75020]:     <system>
Nov 30 10:59:41 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:59:41 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:59:41 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:59:41 user nova-compute[75020]:       <entry name="serial">492f3123-e679-4a6c-a134-6c7912054463</entry>
Nov 30 10:59:41 user nova-compute[75020]:       <entry name="uuid">492f3123-e679-4a6c-a134-6c7912054463</entry>
Nov 30 10:59:41 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:59:41 user nova-compute[75020]:     </system>
Nov 30 10:59:41 user nova-compute[75020]:   </sysinfo>
Nov 30 10:59:41 user nova-compute[75020]:   <os>
Nov 30 10:59:41 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:59:41 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 10:59:41 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:59:41 user nova-compute[75020]:   </os>
Nov 30 10:59:41 user nova-compute[75020]:   <features>
Nov 30 10:59:41 user nova-compute[75020]:     <acpi/>
Nov 30 10:59:41 user nova-compute[75020]:     <apic/>
Nov 30 10:59:41 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:59:41 user nova-compute[75020]:   </features>
Nov 30 10:59:41 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:59:41 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:59:41 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:59:41 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:59:41 user nova-compute[75020]:   </clock>
Nov 30 10:59:41 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:59:41 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:59:41 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:59:41 user nova-compute[75020]:   </cpu>
Nov 30 10:59:41 user nova-compute[75020]:   <devices>
Nov 30 10:59:41 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 10:59:41 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 10:59:41 user nova-compute[75020]:       <source dev="/dev/sdd"/>
Nov 30 10:59:41 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:59:41 user nova-compute[75020]:       <serial>b258d561-61a3-4f4a-8731-f7bf0f714e15</serial>
Nov 30 10:59:41 user nova-compute[75020]:     </disk>
Nov 30 10:59:41 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:59:41 user nova-compute[75020]:       <mac address="fa:16:3e:94:99:3d"/>
Nov 30 10:59:41 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:41 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:59:41 user nova-compute[75020]:       <target dev="tap5f3c71a3-cf"/>
Nov 30 10:59:41 user nova-compute[75020]:     </interface>
Nov 30 10:59:41 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:59:41 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/console.log" append="off"/>
Nov 30 10:59:41 user nova-compute[75020]:     </serial>
Nov 30 10:59:41 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:59:41 user nova-compute[75020]:     <video>
Nov 30 10:59:41 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:41 user nova-compute[75020]:     </video>
Nov 30 10:59:41 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:59:41 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:59:41 user nova-compute[75020]:     </rng>
Nov 30 10:59:41 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:59:41 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:59:41 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:59:41 user nova-compute[75020]:     </memballoon>
Nov 30 10:59:41 user nova-compute[75020]:   </devices>
Nov 30 10:59:41 user nova-compute[75020]: </domain>
Nov 30 10:59:41 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-745636477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-745636477',id=27,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-cttz0m7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:19Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=492f3123-e679-4a6c-a134-6c7912054463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:99:3d,bridge_name='br-int',has_traffic_filtering=True,id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c71a3-cf') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_vif [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:99:3d,bridge_name='br-int',has_traffic_filtering=True,id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c71a3-cf') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd588e83b-229a-56cd-9722-99a1fa692e60', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f3c71a3-cf, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f3c71a3-cf, col_values=(('qos', UUID('89c09fd7-9a38-43a0-9d3d-729d4593b32d')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f3c71a3-cf, col_values=(('external_ids', {'iface-id': '5f3c71a3-cf0b-4895-a021-ef8d3969b3b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:99:3d', 'vm-uuid': '492f3123-e679-4a6c-a134-6c7912054463'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2af07d-7c94-417e-8c1c-e648107a367a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:41 user nova-compute[75020]: INFO os_vif [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:99:3d,bridge_name='br-int',has_traffic_filtering=True,id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c71a3-cf')
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[448a033e-cb39-4cef-a6cf-c8dbaf8cb21d]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a08e98-aa8c-493d-8465-191ac482e9e7]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No VIF found with MAC fa:16:3e:94:99:3d, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b35686-e560-4cc9-b453-132a07d94533]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a897d6a5-edf3-4a49-9e3e-6fdf38324f98]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-cc0f2cd9-b4a1-4cf8-8648-ded6102425ab req-5997c8ba-2573-4b8f-acca-e78e22b47a5c service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received event network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc0f2cd9-b4a1-4cf8-8648-ded6102425ab req-5997c8ba-2573-4b8f-acca-e78e22b47a5c service nova] Acquiring lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc0f2cd9-b4a1-4cf8-8648-ded6102425ab req-5997c8ba-2573-4b8f-acca-e78e22b47a5c service nova] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cc0f2cd9-b4a1-4cf8-8648-ded6102425ab req-5997c8ba-2573-4b8f-acca-e78e22b47a5c service nova] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-cc0f2cd9-b4a1-4cf8-8648-ded6102425ab req-5997c8ba-2573-4b8f-acca-e78e22b47a5c service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] No waiting events found dispatching network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:41 user nova-compute[75020]: WARNING nova.compute.manager [req-cc0f2cd9-b4a1-4cf8-8648-ded6102425ab req-5997c8ba-2573-4b8f-acca-e78e22b47a5c service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received unexpected event network-vif-plugged-69ac1e82-691b-456a-bf81-65a2a0aaadb9 for instance with vm_state active and task_state deleting.
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-b25b63fa-341c-41fc-9c21-e67640d6d46a req-ec69cb38-8a96-4b6d-8919-d92c955c1354 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b25b63fa-341c-41fc-9c21-e67640d6d46a req-ec69cb38-8a96-4b6d-8919-d92c955c1354 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b25b63fa-341c-41fc-9c21-e67640d6d46a req-ec69cb38-8a96-4b6d-8919-d92c955c1354 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b25b63fa-341c-41fc-9c21-e67640d6d46a req-ec69cb38-8a96-4b6d-8919-d92c955c1354 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-b25b63fa-341c-41fc-9c21-e67640d6d46a req-ec69cb38-8a96-4b6d-8919-d92c955c1354 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:41 user nova-compute[75020]: WARNING nova.compute.manager [req-b25b63fa-341c-41fc-9c21-e67640d6d46a req-ec69cb38-8a96-4b6d-8919-d92c955c1354 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state building and task_state spawning.
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91977f9-f846-4f08-8453-f22a605bf707]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2, portal: 172.16.0.220,3260]
Nov 30 10:59:41 user nova-compute[75020]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2, portal: 172.16.0.220,3260] successful.
Nov 30 10:59:41 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e09d370-e70a-4556-8ca3-7696805e0ba2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e55f418-96c2-4180-9286-e02315f1a6e0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== disconnect_volume: return (1622ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 10:59:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Deleting instance files /opt/stack/data/nova/instances/b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f_del
Nov 30 10:59:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Deletion of /opt/stack/data/nova/instances/b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f_del complete
Nov 30 10:59:41 user nova-compute[75020]: INFO nova.compute.manager [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Took 2.62 seconds to destroy the instance on the hypervisor.
Nov 30 10:59:41 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:59:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance spawned successfully.
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:42 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Took 0.43 seconds to deallocate network for instance.
Nov 30 10:59:42 user nova-compute[75020]: INFO nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 30 10:59:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:59:42 user nova-compute[75020]: INFO nova.compute.manager [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Took 16.14 seconds to build instance.
Nov 30 10:59:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-00375ab3-6607-40c1-96d1-3492256bb410 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.252s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-2d7fbd22-c4fc-4bc4-90be-0837c0f460b5 req-1950b8f3-eb0a-4629-a76b-dc45e1fa94f1 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d7fbd22-c4fc-4bc4-90be-0837c0f460b5 req-1950b8f3-eb0a-4629-a76b-dc45e1fa94f1 service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d7fbd22-c4fc-4bc4-90be-0837c0f460b5 req-1950b8f3-eb0a-4629-a76b-dc45e1fa94f1 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2d7fbd22-c4fc-4bc4-90be-0837c0f460b5 req-1950b8f3-eb0a-4629-a76b-dc45e1fa94f1 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-2d7fbd22-c4fc-4bc4-90be-0837c0f460b5 req-1950b8f3-eb0a-4629-a76b-dc45e1fa94f1 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:42 user nova-compute[75020]: WARNING nova.compute.manager [req-2d7fbd22-c4fc-4bc4-90be-0837c0f460b5 req-1950b8f3-eb0a-4629-a76b-dc45e1fa94f1 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state building and task_state spawning.
Nov 30 10:59:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:43 user nova-compute[75020]: INFO nova.compute.manager [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Took 1.08 seconds to detach 1 volumes for instance.
Nov 30 10:59:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Deleting volume: 5e09d370-e70a-4556-8ca3-7696805e0ba2 {{(pid=75020) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:43 user nova-compute[75020]: INFO nova.compute.manager [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Terminating instance
Nov 30 10:59:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdab2761-1601-43fd-84e3-6cdc51b11f9b req-cc54f8b9-51bb-409e-861c-6aaf6b76ce22 service nova] [instance: b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f] Received event network-vif-deleted-69ac1e82-691b-456a-bf81-65a2a0aaadb9 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdab2761-1601-43fd-84e3-6cdc51b11f9b req-cc54f8b9-51bb-409e-861c-6aaf6b76ce22 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdab2761-1601-43fd-84e3-6cdc51b11f9b req-cc54f8b9-51bb-409e-861c-6aaf6b76ce22 service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdab2761-1601-43fd-84e3-6cdc51b11f9b req-cc54f8b9-51bb-409e-861c-6aaf6b76ce22 service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdab2761-1601-43fd-84e3-6cdc51b11f9b req-cc54f8b9-51bb-409e-861c-6aaf6b76ce22 service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdab2761-1601-43fd-84e3-6cdc51b11f9b req-cc54f8b9-51bb-409e-861c-6aaf6b76ce22 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdab2761-1601-43fd-84e3-6cdc51b11f9b req-cc54f8b9-51bb-409e-861c-6aaf6b76ce22 service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-unplugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:59:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.632s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:43 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Deleted allocations for instance b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f
Nov 30 10:59:44 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:44 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Instance destroyed successfully.
Nov 30 10:59:44 user nova-compute[75020]: DEBUG nova.objects.instance [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lazy-loading 'resources' on Instance uuid fae5310f-5516-4349-ad31-4df9453171a7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1528753811',display_name='tempest-ServerStableDeviceRescueTest-server-1528753811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1528753811',id=17,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkAChtDxffRIlPGYFGRuJtAVkekQcw1uV8ePrIIuQr5SosrYxX3CAafIjEH3mP8UFojTtie6pHZd29rHhWQHbfV+u8DDejqZQRsBEATIYQ92TlesQyXERYqkULA9v27yQ==',key_name='tempest-keypair-1223282536',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55004ba1e4574301bb3719f8b844e4b3',ramdisk_id='',reservation_id='r-itm15rol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1531770868',owner_user_name='tempest-ServerStableDeviceRescueTest-1531770868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da395ea928bf46038b99ad9a07316e0c',uuid=fae5310f-5516-4349-ad31-4df9453171a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Converting VIF {"id": "3a7eecf5-e982-408c-a25e-885e6d940868", "address": "fa:16:3e:8c:1b:db", "network": {"id": "606a02ce-3a02-4189-b153-058024e588a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-546127849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55004ba1e4574301bb3719f8b844e4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7eecf5-e9", "ovs_interfaceid": "3a7eecf5-e982-408c-a25e-885e6d940868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1b:db,bridge_name='br-int',has_traffic_filtering=True,id=3a7eecf5-e982-408c-a25e-885e6d940868,network=Network(606a02ce-3a02-4189-b153-058024e588a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7eecf5-e9') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG os_vif [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1b:db,bridge_name='br-int',has_traffic_filtering=True,id=3a7eecf5-e982-408c-a25e-885e6d940868,network=Network(606a02ce-3a02-4189-b153-058024e588a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7eecf5-e9') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a7eecf5-e9, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9eef53b-69a8-4fa1-969e-bb5fdfe445b6) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 10:59:44 user nova-compute[75020]: INFO os_vif [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1b:db,bridge_name='br-int',has_traffic_filtering=True,id=3a7eecf5-e982-408c-a25e-885e6d940868,network=Network(606a02ce-3a02-4189-b153-058024e588a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7eecf5-e9')
Nov 30 10:59:44 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Deleting instance files /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7_del
Nov 30 10:59:44 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Deletion of /opt/stack/data/nova/instances/fae5310f-5516-4349-ad31-4df9453171a7_del complete
Nov 30 10:59:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e2c71c43-6af5-4513-8d55-2d7c374a38dd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "b8ddf2ce-4fd7-4e17-b9f2-cfec0912737f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.081s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:44 user nova-compute[75020]: INFO nova.compute.manager [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 10:59:44 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:44 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Took 0.76 seconds to deallocate network for instance.
Nov 30 10:59:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:44 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-74c02708-c1b1-4781-8a65-b5730df95e2c req-869f1618-9dd9-4395-b0c3-0dea83b32818 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-74c02708-c1b1-4781-8a65-b5730df95e2c req-869f1618-9dd9-4395-b0c3-0dea83b32818 service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-74c02708-c1b1-4781-8a65-b5730df95e2c req-869f1618-9dd9-4395-b0c3-0dea83b32818 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-74c02708-c1b1-4781-8a65-b5730df95e2c req-869f1618-9dd9-4395-b0c3-0dea83b32818 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-74c02708-c1b1-4781-8a65-b5730df95e2c req-869f1618-9dd9-4395-b0c3-0dea83b32818 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:45 user nova-compute[75020]: WARNING nova.compute.manager [req-74c02708-c1b1-4781-8a65-b5730df95e2c req-869f1618-9dd9-4395-b0c3-0dea83b32818 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state building and task_state spawning.
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 10:59:45 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance spawned successfully.
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 10:59:45 user nova-compute[75020]: INFO nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:59:45 user nova-compute[75020]: INFO nova.compute.manager [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Took 27.41 seconds to build instance.
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2a542f9a-f249-4bd7-969a-04b68ee85a7e tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "492f3123-e679-4a6c-a134-6c7912054463" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.520s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:45 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Deleted allocations for instance fae5310f-5516-4349-ad31-4df9453171a7
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-05b81655-89da-430a-817b-745a32690cd3 req-3ebd970f-9dd4-4a3c-8b4d-96e1efe3cf5d service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-05b81655-89da-430a-817b-745a32690cd3 req-3ebd970f-9dd4-4a3c-8b4d-96e1efe3cf5d service nova] Acquiring lock "fae5310f-5516-4349-ad31-4df9453171a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-05b81655-89da-430a-817b-745a32690cd3 req-3ebd970f-9dd4-4a3c-8b4d-96e1efe3cf5d service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-05b81655-89da-430a-817b-745a32690cd3 req-3ebd970f-9dd4-4a3c-8b4d-96e1efe3cf5d service nova] Lock "fae5310f-5516-4349-ad31-4df9453171a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-05b81655-89da-430a-817b-745a32690cd3 req-3ebd970f-9dd4-4a3c-8b4d-96e1efe3cf5d service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] No waiting events found dispatching network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:45 user nova-compute[75020]: WARNING nova.compute.manager [req-05b81655-89da-430a-817b-745a32690cd3 req-3ebd970f-9dd4-4a3c-8b4d-96e1efe3cf5d service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received unexpected event network-vif-plugged-3a7eecf5-e982-408c-a25e-885e6d940868 for instance with vm_state deleted and task_state None.
Nov 30 10:59:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-05b81655-89da-430a-817b-745a32690cd3 req-3ebd970f-9dd4-4a3c-8b4d-96e1efe3cf5d service nova] [instance: fae5310f-5516-4349-ad31-4df9453171a7] Received event network-vif-deleted-3a7eecf5-e982-408c-a25e-885e6d940868 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-264dda2f-38d3-4c82-9b34-397976da1b30 tempest-ServerStableDeviceRescueTest-1531770868 tempest-ServerStableDeviceRescueTest-1531770868-project-member] Lock "fae5310f-5516-4349-ad31-4df9453171a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.486s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:47 user nova-compute[75020]: INFO nova.compute.manager [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Rescuing
Nov 30 10:59:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 10:59:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquired lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 10:59:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updating instance_info_cache with network_info: [{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Releasing lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-e4021e81-c79f-4c13-b485-7224970948c6 req-f6f70a03-f5d0-4c74-b840-5d25d549bd4c service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4021e81-c79f-4c13-b485-7224970948c6 req-f6f70a03-f5d0-4c74-b840-5d25d549bd4c service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4021e81-c79f-4c13-b485-7224970948c6 req-f6f70a03-f5d0-4c74-b840-5d25d549bd4c service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4021e81-c79f-4c13-b485-7224970948c6 req-f6f70a03-f5d0-4c74-b840-5d25d549bd4c service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-e4021e81-c79f-4c13-b485-7224970948c6 req-f6f70a03-f5d0-4c74-b840-5d25d549bd4c service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:48 user nova-compute[75020]: WARNING nova.compute.manager [req-e4021e81-c79f-4c13-b485-7224970948c6 req-f6f70a03-f5d0-4c74-b840-5d25d549bd4c service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state active and task_state rescuing.
Nov 30 10:59:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance destroyed successfully.
Nov 30 10:59:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Attempting rescue
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75020) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance directory exists: not creating {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 10:59:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Creating image(s)
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'trusted_certs' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue" returned: 0 in 0.059s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'migration_context' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.base [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<13d43551-5590-4e96-a197-fe2556e080c5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Start _get_guest_xml network_info=[{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:58:45:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'resources' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.base [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<13d43551-5590-4e96-a197-fe2556e080c5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'numa_topology' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.base [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<13d43551-5590-4e96-a197-fe2556e080c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:49 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:49 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.base [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<13d43551-5590-4e96-a197-fe2556e080c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1477575849',display_name='tempest-ServerRescueNegativeTestJSON-server-1477575849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1477575849',id=20,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-206orr2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:55:11Z,user_data=None,user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=13d43551-5590-4e96-a197-fe2556e080c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:58:45:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:58:45:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:45:1d,bridge_name='br-int',has_traffic_filtering=True,id=e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape987d4f5-0e') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'pci_devices' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.objects.base [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<13d43551-5590-4e96-a197-fe2556e080c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] End _get_guest_xml xml=<domain type="kvm">
Nov 30 10:59:49 user nova-compute[75020]:   <uuid>13d43551-5590-4e96-a197-fe2556e080c5</uuid>
Nov 30 10:59:49 user nova-compute[75020]:   <name>instance-00000014</name>
Nov 30 10:59:49 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 10:59:49 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 10:59:49 user nova-compute[75020]:   <metadata>
Nov 30 10:59:49 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 10:59:49 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 10:59:49 user nova-compute[75020]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1477575849</nova:name>
Nov 30 10:59:49 user nova-compute[75020]:       <nova:creationTime>2023-11-30 10:59:49</nova:creationTime>
Nov 30 10:59:49 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 10:59:49 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 10:59:49 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 10:59:49 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 10:59:49 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 10:59:49 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 10:59:49 user nova-compute[75020]:       </nova:flavor>
Nov 30 10:59:49 user nova-compute[75020]:       <nova:owner>
Nov 30 10:59:49 user nova-compute[75020]:         <nova:user uuid="2cee10a54cf845a6a328df4e9ea4be85">tempest-ServerRescueNegativeTestJSON-2071093195-project-member</nova:user>
Nov 30 10:59:49 user nova-compute[75020]:         <nova:project uuid="8f16bf7c990e4b7c945642594b58584e">tempest-ServerRescueNegativeTestJSON-2071093195</nova:project>
Nov 30 10:59:49 user nova-compute[75020]:       </nova:owner>
Nov 30 10:59:49 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 10:59:49 user nova-compute[75020]:       <nova:ports>
Nov 30 10:59:49 user nova-compute[75020]:         <nova:port uuid="e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0">
Nov 30 10:59:49 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 10:59:49 user nova-compute[75020]:         </nova:port>
Nov 30 10:59:49 user nova-compute[75020]:       </nova:ports>
Nov 30 10:59:49 user nova-compute[75020]:     </nova:instance>
Nov 30 10:59:49 user nova-compute[75020]:   </metadata>
Nov 30 10:59:49 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 10:59:49 user nova-compute[75020]:     <system>
Nov 30 10:59:49 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 10:59:49 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 10:59:49 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 10:59:49 user nova-compute[75020]:       <entry name="serial">13d43551-5590-4e96-a197-fe2556e080c5</entry>
Nov 30 10:59:49 user nova-compute[75020]:       <entry name="uuid">13d43551-5590-4e96-a197-fe2556e080c5</entry>
Nov 30 10:59:49 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 10:59:49 user nova-compute[75020]:     </system>
Nov 30 10:59:49 user nova-compute[75020]:   </sysinfo>
Nov 30 10:59:49 user nova-compute[75020]:   <os>
Nov 30 10:59:49 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 10:59:49 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 10:59:49 user nova-compute[75020]:   </os>
Nov 30 10:59:49 user nova-compute[75020]:   <features>
Nov 30 10:59:49 user nova-compute[75020]:     <acpi/>
Nov 30 10:59:49 user nova-compute[75020]:     <apic/>
Nov 30 10:59:49 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 10:59:49 user nova-compute[75020]:   </features>
Nov 30 10:59:49 user nova-compute[75020]:   <clock offset="utc">
Nov 30 10:59:49 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 10:59:49 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 10:59:49 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 10:59:49 user nova-compute[75020]:   </clock>
Nov 30 10:59:49 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 10:59:49 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 10:59:49 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 10:59:49 user nova-compute[75020]:   </cpu>
Nov 30 10:59:49 user nova-compute[75020]:   <devices>
Nov 30 10:59:49 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:59:49 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:59:49 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue"/>
Nov 30 10:59:49 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 10:59:49 user nova-compute[75020]:     </disk>
Nov 30 10:59:49 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 10:59:49 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 10:59:49 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk"/>
Nov 30 10:59:49 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 10:59:49 user nova-compute[75020]:     </disk>
Nov 30 10:59:49 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 10:59:49 user nova-compute[75020]:       <mac address="fa:16:3e:58:45:1d"/>
Nov 30 10:59:49 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:49 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 10:59:49 user nova-compute[75020]:       <target dev="tape987d4f5-0e"/>
Nov 30 10:59:49 user nova-compute[75020]:     </interface>
Nov 30 10:59:49 user nova-compute[75020]:     <serial type="pty">
Nov 30 10:59:49 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/console.log" append="off"/>
Nov 30 10:59:49 user nova-compute[75020]:     </serial>
Nov 30 10:59:49 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 10:59:49 user nova-compute[75020]:     <video>
Nov 30 10:59:49 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 10:59:49 user nova-compute[75020]:     </video>
Nov 30 10:59:49 user nova-compute[75020]:     <rng model="virtio">
Nov 30 10:59:49 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 10:59:49 user nova-compute[75020]:     </rng>
Nov 30 10:59:49 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 10:59:49 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 10:59:49 user nova-compute[75020]:       <stats period="10"/>
Nov 30 10:59:49 user nova-compute[75020]:     </memballoon>
Nov 30 10:59:49 user nova-compute[75020]:   </devices>
Nov 30 10:59:49 user nova-compute[75020]: </domain>
Nov 30 10:59:49 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 10:59:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance destroyed successfully.
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 10:59:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No VIF found with MAC fa:16:3e:58:45:1d, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-09ae5237-a3a9-45f7-b9f1-ce4aa5a5d23a req-c57cfc2a-4946-418f-93ec-7be9663852c3 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-09ae5237-a3a9-45f7-b9f1-ce4aa5a5d23a req-c57cfc2a-4946-418f-93ec-7be9663852c3 service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-09ae5237-a3a9-45f7-b9f1-ce4aa5a5d23a req-c57cfc2a-4946-418f-93ec-7be9663852c3 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-09ae5237-a3a9-45f7-b9f1-ce4aa5a5d23a req-c57cfc2a-4946-418f-93ec-7be9663852c3 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-09ae5237-a3a9-45f7-b9f1-ce4aa5a5d23a req-c57cfc2a-4946-418f-93ec-7be9663852c3 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:50 user nova-compute[75020]: WARNING nova.compute.manager [req-09ae5237-a3a9-45f7-b9f1-ce4aa5a5d23a req-c57cfc2a-4946-418f-93ec-7be9663852c3 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state active and task_state rescuing.
Nov 30 10:59:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:53 user nova-compute[75020]: WARNING nova.compute.manager [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state active and task_state rescuing.
Nov 30 10:59:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:53 user nova-compute[75020]: WARNING nova.compute.manager [req-04d8ac86-9752-4d90-9897-a68fb8bc84a4 req-4c276aa8-5502-4d43-9e99-25c9f0a336e5 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state active and task_state rescuing.
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-5357bdab-3a6e-4f4d-9957-57760116f0f0 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 10:59:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 10:59:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7423MB free_disk=24.961875915527344GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 875f4516-89d8-432e-aaee-840162613ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 61543d0a-92b8-4276-8301-4620468f0189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e35772a3-9a06-4ae7-bf6d-e433fee4dee6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 492f3123-e679-4a6c-a134-6c7912054463 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e135a295-5025-4013-bb21-634a2837f0d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 10:59:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 10:59:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:58 user nova-compute[75020]: INFO nova.compute.manager [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Terminating instance
Nov 30 10:59:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-c68483be-9bad-4651-852a-a459096bb08e req-623e52f6-337f-4c35-a29d-700648023f39 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received event network-vif-unplugged-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c68483be-9bad-4651-852a-a459096bb08e req-623e52f6-337f-4c35-a29d-700648023f39 service nova] Acquiring lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c68483be-9bad-4651-852a-a459096bb08e req-623e52f6-337f-4c35-a29d-700648023f39 service nova] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c68483be-9bad-4651-852a-a459096bb08e req-623e52f6-337f-4c35-a29d-700648023f39 service nova] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-c68483be-9bad-4651-852a-a459096bb08e req-623e52f6-337f-4c35-a29d-700648023f39 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] No waiting events found dispatching network-vif-unplugged-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 10:59:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-c68483be-9bad-4651-852a-a459096bb08e req-623e52f6-337f-4c35-a29d-700648023f39 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received event network-vif-unplugged-dbacff31-3e56-4e81-9688-f9b4514c9811 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:59 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Instance destroyed successfully.
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lazy-loading 'resources' on Instance uuid d7b8ec6d-d309-41dd-bfac-ba8b079fa979 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1051085553',display_name='tempest-ServersNegativeTestJSON-server-1051085553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1051085553',id=15,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:51:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07be013073c84dd2bb58b842e6257b57',ramdisk_id='',reservation_id='r-18bv8xv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-263556413',owner_user_name='tempest-ServersNegativeTestJSON-263556413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:51:14Z,user_data=None,user_id='0e5b64476e654197817bd4c65a9ff9c3',uuid=d7b8ec6d-d309-41dd-bfac-ba8b079fa979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converting VIF {"id": "dbacff31-3e56-4e81-9688-f9b4514c9811", "address": "fa:16:3e:af:95:7c", "network": {"id": "5da85615-7b0b-45b5-bcea-075ce7d76f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-928319727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07be013073c84dd2bb58b842e6257b57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbacff31-3e", "ovs_interfaceid": "dbacff31-3e56-4e81-9688-f9b4514c9811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:95:7c,bridge_name='br-int',has_traffic_filtering=True,id=dbacff31-3e56-4e81-9688-f9b4514c9811,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbacff31-3e') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG os_vif [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:95:7c,bridge_name='br-int',has_traffic_filtering=True,id=dbacff31-3e56-4e81-9688-f9b4514c9811,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbacff31-3e') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbacff31-3e, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58428650-0918-4f48-9e13-751efa7efdf3) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 10:59:59 user nova-compute[75020]: INFO os_vif [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:95:7c,bridge_name='br-int',has_traffic_filtering=True,id=dbacff31-3e56-4e81-9688-f9b4514c9811,network=Network(5da85615-7b0b-45b5-bcea-075ce7d76f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbacff31-3e')
Nov 30 10:59:59 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Deleting instance files /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979_del
Nov 30 10:59:59 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Deletion of /opt/stack/data/nova/instances/d7b8ec6d-d309-41dd-bfac-ba8b079fa979_del complete
Nov 30 10:59:59 user nova-compute[75020]: INFO nova.compute.manager [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 30 10:59:59 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:59 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Took 0.50 seconds to deallocate network for instance.
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-b1979ddc-0d30-4650-8b92-fd6671581874 req-2741c4ed-87e6-4594-bda2-deca09820ee1 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received event network-vif-deleted-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 10:59:59 user nova-compute[75020]: INFO nova.compute.manager [req-b1979ddc-0d30-4650-8b92-fd6671581874 req-2741c4ed-87e6-4594-bda2-deca09820ee1 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Neutron deleted interface dbacff31-3e56-4e81-9688-f9b4514c9811; detaching it from the instance and deleting it from the info cache
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.network.neutron [req-b1979ddc-0d30-4650-8b92-fd6671581874 req-2741c4ed-87e6-4594-bda2-deca09820ee1 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-b1979ddc-0d30-4650-8b92-fd6671581874 req-2741c4ed-87e6-4594-bda2-deca09820ee1 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Detach interface failed, port_id=dbacff31-3e56-4e81-9688-f9b4514c9811, reason: Instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 10:59:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:00 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:00:00 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:00:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:00 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Deleted allocations for instance d7b8ec6d-d309-41dd-bfac-ba8b079fa979
Nov 30 11:00:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a2b0e39e-5e13-4cef-8a49-157a25d2ae19 tempest-ServersNegativeTestJSON-263556413 tempest-ServersNegativeTestJSON-263556413-project-member] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.458s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-608b33e3-d46a-405c-93b9-c04d9de67ce6 req-a7494b6e-1653-47cd-b215-d5b3b9041e04 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received event network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:00:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-608b33e3-d46a-405c-93b9-c04d9de67ce6 req-a7494b6e-1653-47cd-b215-d5b3b9041e04 service nova] Acquiring lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-608b33e3-d46a-405c-93b9-c04d9de67ce6 req-a7494b6e-1653-47cd-b215-d5b3b9041e04 service nova] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-608b33e3-d46a-405c-93b9-c04d9de67ce6 req-a7494b6e-1653-47cd-b215-d5b3b9041e04 service nova] Lock "d7b8ec6d-d309-41dd-bfac-ba8b079fa979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-608b33e3-d46a-405c-93b9-c04d9de67ce6 req-a7494b6e-1653-47cd-b215-d5b3b9041e04 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] No waiting events found dispatching network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:00:00 user nova-compute[75020]: WARNING nova.compute.manager [req-608b33e3-d46a-405c-93b9-c04d9de67ce6 req-a7494b6e-1653-47cd-b215-d5b3b9041e04 service nova] [instance: d7b8ec6d-d309-41dd-bfac-ba8b079fa979] Received unexpected event network-vif-plugged-dbacff31-3e56-4e81-9688-f9b4514c9811 for instance with vm_state deleted and task_state None.
Nov 30 11:00:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:00:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-436d3235-5b39-4c29-a945-860af0d0abeb req-07d2cd11-3b91-4edc-9571-9ded6ffbcc87 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received event network-changed-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:00:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-436d3235-5b39-4c29-a945-860af0d0abeb req-07d2cd11-3b91-4edc-9571-9ded6ffbcc87 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Refreshing instance network info cache due to event network-changed-088ea6c2-0c4a-4f91-8464-f9c56da8f397. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:00:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-436d3235-5b39-4c29-a945-860af0d0abeb req-07d2cd11-3b91-4edc-9571-9ded6ffbcc87 service nova] Acquiring lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:00:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-436d3235-5b39-4c29-a945-860af0d0abeb req-07d2cd11-3b91-4edc-9571-9ded6ffbcc87 service nova] Acquired lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:00:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-436d3235-5b39-4c29-a945-860af0d0abeb req-07d2cd11-3b91-4edc-9571-9ded6ffbcc87 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Refreshing network info cache for port 088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:00:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-436d3235-5b39-4c29-a945-860af0d0abeb req-07d2cd11-3b91-4edc-9571-9ded6ffbcc87 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updated VIF entry in instance network info cache for port 088ea6c2-0c4a-4f91-8464-f9c56da8f397. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:00:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-436d3235-5b39-4c29-a945-860af0d0abeb req-07d2cd11-3b91-4edc-9571-9ded6ffbcc87 service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updating instance_info_cache with network_info: [{"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:00:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-436d3235-5b39-4c29-a945-860af0d0abeb req-07d2cd11-3b91-4edc-9571-9ded6ffbcc87 service nova] Releasing lock "refresh_cache-61543d0a-92b8-4276-8301-4620468f0189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:00:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:33 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:00:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:34 user nova-compute[75020]: INFO nova.compute.manager [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Attaching volume 82381e4b-310f-4186-a9d0-b0fab67d6629 to /dev/vdb
Nov 30 11:00:34 user nova-compute[75020]: DEBUG os_brick.utils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb9a38-d8d9-4646-83e5-b78d389c0f45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d5f01-b25d-4bd5-a7b7-3cfe60a2430f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8844d37-c357-4e52-aedb-52f6620f144b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f836aa3d-d39f-41bc-9c2f-f94837855cd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:00:34 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:00:34 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3c87ab-900d-42a4-a333-76e366e9186b]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG os_brick.utils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updating existing volume attachment record: d2b7ec71-3834-426c-8509-f60e57387e9e {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:00:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTpZHajR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:00:43 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:00:43 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:00:43 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21ab7ee-3b78-4c7a-a756-09f02d4bc50e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:00:43 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5199766-457d-47d5-bf41-989c15eec747]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629] added
Nov 30 11:00:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aff8ee-0253-4090-9b53-1459af4af3af]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[270aa134-5a18-4eb3-a3a5-c3cc22520a01]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTpZHajR {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTpZHajR" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987a962-758d-4c6b-b718-ebb65d20e0e9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTpZHajR'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce0c876-cb13-43f2-9efc-4ee49815f345]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad806ba-6da4-4f97-b322-e08816042363]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b3cec-a3b6-422a-8c18-92323280020e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629, portal: 172.16.0.220,3260]
Nov 30 11:00:44 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629, portal: 172.16.0.220,3260] successful.
Nov 30 11:00:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a188f-7315-4c34-ab79-3e028428bb3f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0969d790-e3de-4830-8b5a-0276de64c19b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0645e951-c205-4603-a155-aee5f71c3d15]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTpZHajR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23838333733616432', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838333733616432', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:00:45 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:00:45 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 11:00:45 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:00:45 user nova-compute[75020]:   <serial>82381e4b-310f-4186-a9d0-b0fab67d6629</serial>
Nov 30 11:00:45 user nova-compute[75020]: </disk>
Nov 30 11:00:45 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No VIF found with MAC fa:16:3e:f8:aa:f5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b453e8ec-8ca7-4883-a7bd-2df05d4004d9 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.767s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:00:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:46 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:00:46 user nova-compute[75020]: INFO nova.compute.claims [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Claim successful on node user
Nov 30 11:00:47 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:00:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:00:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG nova.policy [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19afae8899f440c78b8a442361d5b531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c52e77c7064c97bc18c9df58ae20ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:00:47 user nova-compute[75020]: INFO nova.virt.block_device [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Booting with volume 21095494-2701-4e0d-ac03-54fff2eabc06 at /dev/vda
Nov 30 11:00:47 user nova-compute[75020]: DEBUG os_brick.utils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c3ffe1-224f-4630-af75-5fc77ec1569b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25f101-13ec-4d48-949f-d4634c893872]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0560ea9-24c4-4453-9925-5a8639541f46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df86e49-fe3e-4685-a45b-1153a3ea969a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:00:47 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:00:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fb88dc-ccdb-489e-986a-0ee4ed0a5530]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG os_brick.utils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:00:47 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Updating existing volume attachment record: e255c067-283e-4cbb-bd52-72c296958e51 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Skipping network cache update for instance because it is Building. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid d88214a8-f7f1-4735-8faf-611d70a77d9f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Successfully created port: e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:00:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:49 user nova-compute[75020]: INFO nova.compute.manager [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Attaching volume fb1d3e01-9e58-4ccb-97d6-615473c84dd4 to /dev/vdc
Nov 30 11:00:49 user nova-compute[75020]: DEBUG os_brick.utils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b44af28-f7f1-4753-9865-052ddf32bf47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[913d0962-ef0e-42ef-8a73-8008cdc20ebf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[15926337-e8bd-4530-b064-ae7f5ae08a3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b31cbc-63a2-4f70-b9ff-5652b77ba4ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:00:49 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba16162a-2e56-404d-b40b-cdffd006b1ee]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG os_brick.utils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updating existing volume attachment record: 9dce8a0e-087e-4f8e-9f91-0cece7374983 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updating instance_info_cache with network_info: [{"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Successfully updated port: e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquired lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-f836dffe-6013-48ce-93ef-077eb4e0896c req-b97e58cd-bb3e-4d79-970b-c925df8b2fcc service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received event network-changed-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-f836dffe-6013-48ce-93ef-077eb4e0896c req-b97e58cd-bb3e-4d79-970b-c925df8b2fcc service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Refreshing instance network info cache due to event network-changed-e0021916-7934-4154-b33c-b4c100e51448. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f836dffe-6013-48ce-93ef-077eb4e0896c req-b97e58cd-bb3e-4d79-970b-c925df8b2fcc service nova] Acquiring lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:00:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Updating instance_info_cache with network_info: [{"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Releasing lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Instance network_info: |[{"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f836dffe-6013-48ce-93ef-077eb4e0896c req-b97e58cd-bb3e-4d79-970b-c925df8b2fcc service nova] Acquired lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-f836dffe-6013-48ce-93ef-077eb4e0896c req-b97e58cd-bb3e-4d79-970b-c925df8b2fcc service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Refreshing network info cache for port e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-f836dffe-6013-48ce-93ef-077eb4e0896c req-b97e58cd-bb3e-4d79-970b-c925df8b2fcc service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Updated VIF entry in instance network info cache for port e0021916-7934-4154-b33c-b4c100e51448. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-f836dffe-6013-48ce-93ef-077eb4e0896c req-b97e58cd-bb3e-4d79-970b-c925df8b2fcc service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Updating instance_info_cache with network_info: [{"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f836dffe-6013-48ce-93ef-077eb4e0896c req-b97e58cd-bb3e-4d79-970b-c925df8b2fcc service nova] Releasing lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:00:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:00:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7299MB free_disk=24.97760772705078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:54 user nova-compute[75020]: INFO nova.compute.manager [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Terminating instance
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 875f4516-89d8-432e-aaee-840162613ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 61543d0a-92b8-4276-8301-4620468f0189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e35772a3-9a06-4ae7-bf6d-e433fee4dee6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 492f3123-e679-4a6c-a134-6c7912054463 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e135a295-5025-4013-bb21-634a2837f0d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 08b79baf-8036-4ac4-856d-b7dbce524ec3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-37b29bff-87ec-4b31-8d60-0137a111e86d req-384babbf-73a8-49cc-883f-17ae592fe04e service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-unplugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37b29bff-87ec-4b31-8d60-0137a111e86d req-384babbf-73a8-49cc-883f-17ae592fe04e service nova] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37b29bff-87ec-4b31-8d60-0137a111e86d req-384babbf-73a8-49cc-883f-17ae592fe04e service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-37b29bff-87ec-4b31-8d60-0137a111e86d req-384babbf-73a8-49cc-883f-17ae592fe04e service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-37b29bff-87ec-4b31-8d60-0137a111e86d req-384babbf-73a8-49cc-883f-17ae592fe04e service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] No waiting events found dispatching network-vif-unplugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:00:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-37b29bff-87ec-4b31-8d60-0137a111e86d req-384babbf-73a8-49cc-883f-17ae592fe04e service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-unplugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Instance destroyed successfully.
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lazy-loading 'resources' on Instance uuid e35772a3-9a06-4ae7-bf6d-e433fee4dee6 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T10:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109579761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109579761',id=22,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT8W1BX6gMXbYVws9p8tXcoITcXJxTreWPXHMfF5zJS5l6GCKJvuxQNpVsLnhTOSaVNYw7JU0Jf3KoOdgKN5djdJQWy923wwzCaW58MAtWPBGq8zdUGuy8trqZ4QBcsEQ==',key_name='tempest-keypair-1490479026',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:59:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b0cce29854643d0b730dc664697dee7',ramdisk_id='',reservation_id='r-a1bndffv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1553674360',owner_user_name='tempest-AttachVolumeShelveTestJSON-1553674360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d431a8177f54de08c3d0c03a3c9ff1e',uuid=e35772a3-9a06-4ae7-bf6d-e433fee4dee6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converting VIF {"id": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "address": "fa:16:3e:97:bb:1c", "network": {"id": "170d5656-88e2-4242-bb07-f55e895bc1da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2137782923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0cce29854643d0b730dc664697dee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefbdff1-5f", "ovs_interfaceid": "aefbdff1-5f9b-4314-9563-07ebbe7a0f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG os_vif [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaefbdff1-5f, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8b991ec-b3c4-4c24-a1be-26de5aa426d2) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:00:55 user nova-compute[75020]: INFO os_vif [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:1c,bridge_name='br-int',has_traffic_filtering=True,id=aefbdff1-5f9b-4314-9563-07ebbe7a0f48,network=Network(170d5656-88e2-4242-bb07-f55e895bc1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefbdff1-5f')
Nov 30 11:00:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Deleting instance files /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6_del
Nov 30 11:00:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Deletion of /opt/stack/data/nova/instances/e35772a3-9a06-4ae7-bf6d-e433fee4dee6_del complete
Nov 30 11:00:55 user nova-compute[75020]: INFO nova.compute.manager [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 30 11:00:55 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:00:56 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Took 1.01 seconds to deallocate network for instance.
Nov 30 11:00:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-57cc13e9-0ead-4153-8f04-49181af97bd0 req-79bb24e1-5c3d-46ed-bfb0-a13237675a50 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-deleted-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b83dc12d-dfa0-43c6-a47b-c49db1d09b87 req-30b9a9f6-06d3-42e6-b59b-1a7443558195 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b83dc12d-dfa0-43c6-a47b-c49db1d09b87 req-30b9a9f6-06d3-42e6-b59b-1a7443558195 service nova] Acquiring lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b83dc12d-dfa0-43c6-a47b-c49db1d09b87 req-30b9a9f6-06d3-42e6-b59b-1a7443558195 service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b83dc12d-dfa0-43c6-a47b-c49db1d09b87 req-30b9a9f6-06d3-42e6-b59b-1a7443558195 service nova] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-b83dc12d-dfa0-43c6-a47b-c49db1d09b87 req-30b9a9f6-06d3-42e6-b59b-1a7443558195 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] No waiting events found dispatching network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:00:56 user nova-compute[75020]: WARNING nova.compute.manager [req-b83dc12d-dfa0-43c6-a47b-c49db1d09b87 req-30b9a9f6-06d3-42e6-b59b-1a7443558195 service nova] [instance: e35772a3-9a06-4ae7-bf6d-e433fee4dee6] Received unexpected event network-vif-plugged-aefbdff1-5f9b-4314-9563-07ebbe7a0f48 for instance with vm_state deleted and task_state None.
Nov 30 11:00:56 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:00:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:56 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Deleted allocations for instance e35772a3-9a06-4ae7-bf6d-e433fee4dee6
Nov 30 11:00:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-56ae5751-2235-4ff2-aeb1-3a4778aea7c0 tempest-AttachVolumeShelveTestJSON-1553674360 tempest-AttachVolumeShelveTestJSON-1553674360-project-member] Lock "e35772a3-9a06-4ae7-bf6d-e433fee4dee6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.615s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:00:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:00:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Creating image(s)
Nov 30 11:00:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:00:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Ensure instance console log exists: /opt/stack/data/nova/instances/08b79baf-8036-4ac4-856d-b7dbce524ec3/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:00:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:00:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:00:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Start _get_guest_xml network_info=[{"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'e255c067-283e-4cbb-bd52-72c296958e51', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pchyjSfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08b79baf-8036-4ac4-856d-b7dbce524ec3', 'attached_at': '', 'detached_at': '', 'volume_id': '21095494-2701-4e0d-ac03-54fff2eabc06', 'serial': '21095494-2701-4e0d-ac03-54fff2eabc06'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:00:58 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:00:58 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pchyjSfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:00:58 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:00:58 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:00:58 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fabea50-5357-4938-823d-bf61e02ff6e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:00:58 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0f15eb-78c4-4d9e-86ff-c3327f02f4ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06] added
Nov 30 11:00:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2881d4b0-a563-462d-be90-70ded709f897]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0629e6d-e185-4551-b22b-7bd3740142da]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pchyjSfr {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pchyjSfr" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[77135117-043e-43e4-bc47-653c53fd86aa]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pchyjSfr'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be2532f-c045-46ed-8fc5-59dc60eb0127]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f356b-998b-4ea1-9b0b-809cc190ead9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee364f23-acd3-4eab-9718-a749daadf392]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06, portal: 172.16.0.220,3260]
Nov 30 11:00:58 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06, portal: 172.16.0.220,3260] successful.
Nov 30 11:00:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dfe27b-251a-421e-ae63-37c2547c50fb]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe066a91-663d-45ff-8918-5c90d3ec5cb1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:00:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2eff31-8a9f-47fe-a099-c79e088c830c]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pchyjSfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:00:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcBfUGAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:00:59 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23366326130343465', 'path': '/dev/sdf'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366326130343465', 'path': '/dev/sdf'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.030s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:00:59 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:00:59 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efcb61a-f385-4cb7-9935-5efa2c471662]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:00:59 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-735717366',display_name='tempest-TestVolumeBootPattern-volume-backed-server-735717366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-735717366',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ+OQt0WFnBa0JpAcyHjrcQaEGMcDSr7/tjUekKH7cMQqLLdZgmfvbuqY0WcKCinO4Un8bznHXHymuRn6rtmwFsLuiGYiyZj4j1RBhrEZLgWqYqEysie9Mp0WJBRt4eIw==',key_name='tempest-keypair-414062164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-sax1ba9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19afae8899f440c78b8a442361d5b531',uuid=08b79baf-8036-4ac4-856d-b7dbce524ec3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:47:00,bridge_name='br-int',has_traffic_filtering=True,id=e0021916-7934-4154-b33c-b4c100e51448,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0021916-79') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.objects.instance [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'pci_devices' on Instance uuid 08b79baf-8036-4ac4-856d-b7dbce524ec3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:00:59 user nova-compute[75020]:   <uuid>08b79baf-8036-4ac4-856d-b7dbce524ec3</uuid>
Nov 30 11:00:59 user nova-compute[75020]:   <name>instance-0000001e</name>
Nov 30 11:00:59 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:00:59 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:00:59 user nova-compute[75020]:   <metadata>
Nov 30 11:00:59 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:00:59 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:00:59 user nova-compute[75020]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-735717366</nova:name>
Nov 30 11:00:59 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:00:58</nova:creationTime>
Nov 30 11:00:59 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:00:59 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:00:59 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:00:59 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:00:59 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:00:59 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:00:59 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:00:59 user nova-compute[75020]:       <nova:owner>
Nov 30 11:00:59 user nova-compute[75020]:         <nova:user uuid="19afae8899f440c78b8a442361d5b531">tempest-TestVolumeBootPattern-1120216767-project-member</nova:user>
Nov 30 11:00:59 user nova-compute[75020]:         <nova:project uuid="54c52e77c7064c97bc18c9df58ae20ef">tempest-TestVolumeBootPattern-1120216767</nova:project>
Nov 30 11:00:59 user nova-compute[75020]:       </nova:owner>
Nov 30 11:00:59 user nova-compute[75020]:       <nova:ports>
Nov 30 11:00:59 user nova-compute[75020]:         <nova:port uuid="e0021916-7934-4154-b33c-b4c100e51448">
Nov 30 11:00:59 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 11:00:59 user nova-compute[75020]:         </nova:port>
Nov 30 11:00:59 user nova-compute[75020]:       </nova:ports>
Nov 30 11:00:59 user nova-compute[75020]:     </nova:instance>
Nov 30 11:00:59 user nova-compute[75020]:   </metadata>
Nov 30 11:00:59 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:00:59 user nova-compute[75020]:     <system>
Nov 30 11:00:59 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:00:59 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:00:59 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:00:59 user nova-compute[75020]:       <entry name="serial">08b79baf-8036-4ac4-856d-b7dbce524ec3</entry>
Nov 30 11:00:59 user nova-compute[75020]:       <entry name="uuid">08b79baf-8036-4ac4-856d-b7dbce524ec3</entry>
Nov 30 11:00:59 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:00:59 user nova-compute[75020]:     </system>
Nov 30 11:00:59 user nova-compute[75020]:   </sysinfo>
Nov 30 11:00:59 user nova-compute[75020]:   <os>
Nov 30 11:00:59 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:00:59 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:00:59 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:00:59 user nova-compute[75020]:   </os>
Nov 30 11:00:59 user nova-compute[75020]:   <features>
Nov 30 11:00:59 user nova-compute[75020]:     <acpi/>
Nov 30 11:00:59 user nova-compute[75020]:     <apic/>
Nov 30 11:00:59 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:00:59 user nova-compute[75020]:   </features>
Nov 30 11:00:59 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:00:59 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:00:59 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:00:59 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:00:59 user nova-compute[75020]:   </clock>
Nov 30 11:00:59 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:00:59 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:00:59 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:00:59 user nova-compute[75020]:   </cpu>
Nov 30 11:00:59 user nova-compute[75020]:   <devices>
Nov 30 11:00:59 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:00:59 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:00:59 user nova-compute[75020]:       <source dev="/dev/sdf"/>
Nov 30 11:00:59 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:00:59 user nova-compute[75020]:       <serial>21095494-2701-4e0d-ac03-54fff2eabc06</serial>
Nov 30 11:00:59 user nova-compute[75020]:     </disk>
Nov 30 11:00:59 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:00:59 user nova-compute[75020]:       <mac address="fa:16:3e:b3:47:00"/>
Nov 30 11:00:59 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:00:59 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:00:59 user nova-compute[75020]:       <target dev="tape0021916-79"/>
Nov 30 11:00:59 user nova-compute[75020]:     </interface>
Nov 30 11:00:59 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:00:59 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/08b79baf-8036-4ac4-856d-b7dbce524ec3/console.log" append="off"/>
Nov 30 11:00:59 user nova-compute[75020]:     </serial>
Nov 30 11:00:59 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:00:59 user nova-compute[75020]:     <video>
Nov 30 11:00:59 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:00:59 user nova-compute[75020]:     </video>
Nov 30 11:00:59 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:00:59 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:00:59 user nova-compute[75020]:     </rng>
Nov 30 11:00:59 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:00:59 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:00:59 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:00:59 user nova-compute[75020]:     </memballoon>
Nov 30 11:00:59 user nova-compute[75020]:   </devices>
Nov 30 11:00:59 user nova-compute[75020]: </domain>
Nov 30 11:00:59 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-735717366',display_name='tempest-TestVolumeBootPattern-volume-backed-server-735717366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-735717366',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ+OQt0WFnBa0JpAcyHjrcQaEGMcDSr7/tjUekKH7cMQqLLdZgmfvbuqY0WcKCinO4Un8bznHXHymuRn6rtmwFsLuiGYiyZj4j1RBhrEZLgWqYqEysie9Mp0WJBRt4eIw==',key_name='tempest-keypair-414062164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-sax1ba9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19afae8899f440c78b8a442361d5b531',uuid=08b79baf-8036-4ac4-856d-b7dbce524ec3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:47:00,bridge_name='br-int',has_traffic_filtering=True,id=e0021916-7934-4154-b33c-b4c100e51448,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0021916-79') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_vif [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:47:00,bridge_name='br-int',has_traffic_filtering=True,id=e0021916-7934-4154-b33c-b4c100e51448,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0021916-79') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88f2d645-c709-5cd4-891b-f24d7d3a8b6b', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a6725-4c46-4cf7-8c43-5df5ce514084]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4] added
Nov 30 11:00:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0021916-79, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0021916-79, col_values=(('qos', UUID('681c2d98-15a6-45f7-957c-8e8eb9386986')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0021916-79, col_values=(('external_ids', {'iface-id': 'e0021916-7934-4154-b33c-b4c100e51448', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:47:00', 'vm-uuid': '08b79baf-8036-4ac4-856d-b7dbce524ec3'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:00:59 user nova-compute[75020]: INFO os_vif [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:47:00,bridge_name='br-int',has_traffic_filtering=True,id=e0021916-7934-4154-b33c-b4c100e51448,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0021916-79')
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[15062d13-ba62-470f-8122-29e95bb3bd63]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5a6a41-c457-403c-85ac-8131c1e78154]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcBfUGAL {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcBfUGAL" returned: 0 in 0.039s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12e95ad-b4b0-4438-b42a-b97bc819a405]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcBfUGAL'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No VIF found with MAC fa:16:3e:b3:47:00, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59b0ea3-ae67-4e1c-ba69-df3e7b79832d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[106aec00-bd57-4e0f-be6e-0309d65aaade]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b841e00-5058-4994-93d8-be97abd07af0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4, portal: 172.16.0.220,3260]
Nov 30 11:00:59 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4, portal: 172.16.0.220,3260] successful.
Nov 30 11:00:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d65f555-34ec-405f-a098-880609663e24]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[21815eaa-8e59-4359-836c-3ecd12b81a5c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:00:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c58aca-a729-45b8-bea4-c040e5beb836]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:00:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcBfUGAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:01:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '23266323466643165', 'path': '/dev/sdg'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266323466643165', 'path': '/dev/sdg'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:01:00 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:01:00 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:00 user nova-compute[75020]:   <source dev="/dev/sdg"/>
Nov 30 11:01:00 user nova-compute[75020]:   <target dev="vdc" bus="virtio"/>
Nov 30 11:01:00 user nova-compute[75020]:   <serial>fb1d3e01-9e58-4ccb-97d6-615473c84dd4</serial>
Nov 30 11:01:00 user nova-compute[75020]: </disk>
Nov 30 11:01:00 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:01:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-8a444141-296c-4703-8ac6-191a8eabfc09 req-6931e7e6-88be-4ed3-b15f-93727462d72e service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received event network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8a444141-296c-4703-8ac6-191a8eabfc09 req-6931e7e6-88be-4ed3-b15f-93727462d72e service nova] Acquiring lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8a444141-296c-4703-8ac6-191a8eabfc09 req-6931e7e6-88be-4ed3-b15f-93727462d72e service nova] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8a444141-296c-4703-8ac6-191a8eabfc09 req-6931e7e6-88be-4ed3-b15f-93727462d72e service nova] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-8a444141-296c-4703-8ac6-191a8eabfc09 req-6931e7e6-88be-4ed3-b15f-93727462d72e service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] No waiting events found dispatching network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:01 user nova-compute[75020]: WARNING nova.compute.manager [req-8a444141-296c-4703-8ac6-191a8eabfc09 req-6931e7e6-88be-4ed3-b15f-93727462d72e service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received unexpected event network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 for instance with vm_state building and task_state spawning.
Nov 30 11:01:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] No VIF found with MAC fa:16:3e:f8:aa:f5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:01:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6037b217-e237-4d95-ac5b-e3c488eb6671 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.796s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:03 user nova-compute[75020]: INFO nova.compute.manager [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Detaching volume 82381e4b-310f-4186-a9d0-b0fab67d6629
Nov 30 11:01:03 user nova-compute[75020]: INFO nova.virt.block_device [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Attempting to driver detach volume 82381e4b-310f-4186-a9d0-b0fab67d6629 from mountpoint /dev/vdb
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Attempting to detach device vdb from instance 61543d0a-92b8-4276-8301-4620468f0189 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:01:03 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:03 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 11:01:03 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:01:03 user nova-compute[75020]:   <serial>82381e4b-310f-4186-a9d0-b0fab67d6629</serial>
Nov 30 11:01:03 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:01:03 user nova-compute[75020]: </disk>
Nov 30 11:01:03 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:01:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully detached device vdb from instance 61543d0a-92b8-4276-8301-4620468f0189 from the persistent domain config.
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61543d0a-92b8-4276-8301-4620468f0189 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:01:03 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:03 user nova-compute[75020]:   <source dev="/dev/sde"/>
Nov 30 11:01:03 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:01:03 user nova-compute[75020]:   <serial>82381e4b-310f-4186-a9d0-b0fab67d6629</serial>
Nov 30 11:01:03 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:01:03 user nova-compute[75020]: </disk>
Nov 30 11:01:03 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-60862133-9233-40fa-b71d-3733e0f02d14 req-747166d1-30b5-4f86-94a4-b3732327842a service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received event network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60862133-9233-40fa-b71d-3733e0f02d14 req-747166d1-30b5-4f86-94a4-b3732327842a service nova] Acquiring lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60862133-9233-40fa-b71d-3733e0f02d14 req-747166d1-30b5-4f86-94a4-b3732327842a service nova] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60862133-9233-40fa-b71d-3733e0f02d14 req-747166d1-30b5-4f86-94a4-b3732327842a service nova] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-60862133-9233-40fa-b71d-3733e0f02d14 req-747166d1-30b5-4f86-94a4-b3732327842a service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] No waiting events found dispatching network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:03 user nova-compute[75020]: WARNING nova.compute.manager [req-60862133-9233-40fa-b71d-3733e0f02d14 req-747166d1-30b5-4f86-94a4-b3732327842a service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received unexpected event network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 for instance with vm_state building and task_state spawning.
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:01:03 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Instance spawned successfully.
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:01:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:03 user nova-compute[75020]: INFO nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 30 11:01:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:01:03 user nova-compute[75020]: INFO nova.compute.manager [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Took 16.93 seconds to build instance.
Nov 30 11:01:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4ed1090b-9013-42fe-a858-82918d0f12a9 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.019s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:08 user nova-compute[75020]: INFO nova.compute.manager [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Rescuing
Nov 30 11:01:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquired lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Updating instance_info_cache with network_info: [{"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Releasing lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-d8429996-c82b-4fc1-90a9-782e0a9b5722 req-1a157bc7-96ec-49c0-af9d-217b118368bb service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d8429996-c82b-4fc1-90a9-782e0a9b5722 req-1a157bc7-96ec-49c0-af9d-217b118368bb service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d8429996-c82b-4fc1-90a9-782e0a9b5722 req-1a157bc7-96ec-49c0-af9d-217b118368bb service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d8429996-c82b-4fc1-90a9-782e0a9b5722 req-1a157bc7-96ec-49c0-af9d-217b118368bb service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-d8429996-c82b-4fc1-90a9-782e0a9b5722 req-1a157bc7-96ec-49c0-af9d-217b118368bb service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:09 user nova-compute[75020]: WARNING nova.compute.manager [req-d8429996-c82b-4fc1-90a9-782e0a9b5722 req-1a157bc7-96ec-49c0-af9d-217b118368bb service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state active and task_state rescuing.
Nov 30 11:01:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance destroyed successfully.
Nov 30 11:01:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Attempting a stable device rescue
Nov 30 11:01:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75020) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 11:01:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance directory exists: not creating {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 11:01:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Creating image(s)
Nov 30 11:01:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "/opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "/opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "/opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:10 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'trusted_certs' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "7fe6e8a5ef4c971fcd368044c0611af83e361db0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "7fe6e8a5ef4c971fcd368044c0611af83e361db0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG nova.virt.images [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] d28cf7be-87e6-4925-b444-1d438e8df375 was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0.part /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-a1609759-fe5e-461b-85e5-84605a03b007 req-3d21c94b-5264-4a4a-bf3c-a335e86cfbde service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received event network-changed-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-a1609759-fe5e-461b-85e5-84605a03b007 req-3d21c94b-5264-4a4a-bf3c-a335e86cfbde service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Refreshing instance network info cache due to event network-changed-bf1932cd-f17b-44b7-ac71-ac89f2031f0d. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a1609759-fe5e-461b-85e5-84605a03b007 req-3d21c94b-5264-4a4a-bf3c-a335e86cfbde service nova] Acquiring lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a1609759-fe5e-461b-85e5-84605a03b007 req-3d21c94b-5264-4a4a-bf3c-a335e86cfbde service nova] Acquired lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-a1609759-fe5e-461b-85e5-84605a03b007 req-3d21c94b-5264-4a4a-bf3c-a335e86cfbde service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Refreshing network info cache for port bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-b8fa5b8d-f301-43ca-9753-ee8b98cff041 req-4d269d09-d450-4439-8731-8db43607e0be service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b8fa5b8d-f301-43ca-9753-ee8b98cff041 req-4d269d09-d450-4439-8731-8db43607e0be service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b8fa5b8d-f301-43ca-9753-ee8b98cff041 req-4d269d09-d450-4439-8731-8db43607e0be service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b8fa5b8d-f301-43ca-9753-ee8b98cff041 req-4d269d09-d450-4439-8731-8db43607e0be service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-b8fa5b8d-f301-43ca-9753-ee8b98cff041 req-4d269d09-d450-4439-8731-8db43607e0be service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:11 user nova-compute[75020]: WARNING nova.compute.manager [req-b8fa5b8d-f301-43ca-9753-ee8b98cff041 req-4d269d09-d450-4439-8731-8db43607e0be service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state active and task_state rescuing.
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0.part /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0.converted" returned: 0 in 0.677s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.network.neutron [req-a1609759-fe5e-461b-85e5-84605a03b007 req-3d21c94b-5264-4a4a-bf3c-a335e86cfbde service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updated VIF entry in instance network info cache for port bf1932cd-f17b-44b7-ac71-ac89f2031f0d. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.network.neutron [req-a1609759-fe5e-461b-85e5-84605a03b007 req-3d21c94b-5264-4a4a-bf3c-a335e86cfbde service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updating instance_info_cache with network_info: [{"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0.converted --force-share --output=json" returned: 0 in 0.271s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "7fe6e8a5ef4c971fcd368044c0611af83e361db0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.356s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "7fe6e8a5ef4c971fcd368044c0611af83e361db0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "7fe6e8a5ef4c971fcd368044c0611af83e361db0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a1609759-fe5e-461b-85e5-84605a03b007 req-3d21c94b-5264-4a4a-bf3c-a335e86cfbde service nova] Releasing lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0 --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0,backing_fmt=raw /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0,backing_fmt=raw /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue" returned: 0 in 0.052s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "7fe6e8a5ef4c971fcd368044c0611af83e361db0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'migration_context' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.objects.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<492f3123-e679-4a6c-a134-6c7912054463> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Start _get_guest_xml network_info=[{"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "vif_mac": "fa:16:3e:94:99:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd28cf7be-87e6-4925-b444-1d438e8df375', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'd7537c87-dcd3-41d1-89f9-fbdd5af9d8da', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtHYEywf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '492f3123-e679-4a6c-a134-6c7912054463', 'attached_at': '', 'detached_at': '', 'volume_id': 'b258d561-61a3-4f4a-8731-f7bf0f714e15', 'serial': 'b258d561-61a3-4f4a-8731-f7bf0f714e15'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'resources' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.objects.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<492f3123-e679-4a6c-a134-6c7912054463> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'numa_topology' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.objects.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<492f3123-e679-4a6c-a134-6c7912054463> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:01:12 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:01:12 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'vcpu_model' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.objects.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<492f3123-e679-4a6c-a134-6c7912054463> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtHYEywf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:12 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:12 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:12 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:01:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cefb705-7bd2-4853-ad9e-ccabfc1fc079]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VtHYEywf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 11:01:13 user nova-compute[75020]: node.name = iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15
Nov 30 11:01:13 user nova-compute[75020]: node.tpgt = -1
Nov 30 11:01:13 user nova-compute[75020]: node.startup = automatic
Nov 30 11:01:13 user nova-compute[75020]: node.leading_login = No
Nov 30 11:01:13 user nova-compute[75020]: iface.iscsi_ifacename = default
Nov 30 11:01:13 user nova-compute[75020]: iface.net_ifacename = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.ipaddress = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.prefix_len = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.hwaddress = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.transport_name = tcp
Nov 30 11:01:13 user nova-compute[75020]: iface.initiatorname = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.state = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.vlan_id = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.vlan_priority = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.vlan_state = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.iface_num = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.mtu = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.port = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.bootproto = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.subnet_mask = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.gateway = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.dhcp_alt_client_id = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.dhcp_dns = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.dhcp_learn_iqn = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.dhcp_vendor_id_state = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.dhcp_vendor_id = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.dhcp_slp_da = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.fragmentation = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.gratuitous_arp = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.incoming_forwarding = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.tos_state = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.tos = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.ttl = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.delayed_ack = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.tcp_nagle = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.tcp_wsf_state = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.tcp_wsf = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.tcp_timer_scale = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.tcp_timestamp = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.redirect = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.def_task_mgmt_timeout = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.header_digest = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.data_digest = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.immediate_data = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.initial_r2t = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.data_seq_inorder = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.data_pdu_inorder = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.erl = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.max_receive_data_len = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.first_burst_len = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.max_outstanding_r2t = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.max_burst_len = 0
Nov 30 11:01:13 user nova-compute[75020]: iface.chap_auth = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.bidi_chap = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.strict_login_compliance = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.discovery_auth = <empty>
Nov 30 11:01:13 user nova-compute[75020]: iface.discovery_logout = <empty>
Nov 30 11:01:13 user nova-compute[75020]: node.discovery_address = <empty>
Nov 30 11:01:13 user nova-compute[75020]: node.discovery_port = 0
Nov 30 11:01:13 user nova-compute[75020]: node.discovery_type = static
Nov 30 11:01:13 user nova-compute[75020]: node.session.initial_cmdsn = 0
Nov 30 11:01:13 user nova-compute[75020]: node.session.initial_login_retry_max = 8
Nov 30 11:01:13 user nova-compute[75020]: node.session.xmit_thread_priority = -20
Nov 30 11:01:13 user nova-compute[75020]: node.session.cmds_max = 128
Nov 30 11:01:13 user nova-compute[75020]: node.session.queue_depth = 32
Nov 30 11:01:13 user nova-compute[75020]: node.session.nr_sessions = 1
Nov 30 11:01:13 user nova-compute[75020]: node.session.auth.authmethod = CHAP
Nov 30 11:01:13 user nova-compute[75020]: node.session.auth.username = VtHYEywf
Nov 30 11:01:13 user nova-compute[75020]: node.session.auth.password = ***
Nov 30 11:01:13 user nova-compute[75020]: node.session.auth.username_in = <empty>
Nov 30 11:01:13 user nova-compute[75020]: node.session.auth.password_in = <empty>
Nov 30 11:01:13 user nova-compute[75020]: node.session.auth.chap_algs = MD5
Nov 30 11:01:13 user nova-compute[75020]: node.session.timeo.replacement_timeout = 120
Nov 30 11:01:13 user nova-compute[75020]: node.session.err_timeo.abort_timeout = 15
Nov 30 11:01:13 user nova-compute[75020]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 11:01:13 user nova-compute[75020]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 11:01:13 user nova-compute[75020]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.FastAbort = Yes
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.InitialR2T = No
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.ImmediateData = Yes
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.MaxConnections = 1
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 11:01:13 user nova-compute[75020]: node.session.iscsi.ERL = 0
Nov 30 11:01:13 user nova-compute[75020]: node.session.scan = manual
Nov 30 11:01:13 user nova-compute[75020]: node.session.reopen_max = 0
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].address = 172.16.0.220
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].port = 3260
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].startup = manual
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].tcp.window_size = 524288
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].tcp.type_of_service = 0
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].timeo.logout_timeout = 15
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].timeo.login_timeout = 15
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].timeo.auth_timeout = 45
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].iscsi.DataDigest = None
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].iscsi.IFMarker = No
Nov 30 11:01:13 user nova-compute[75020]: node.conn[0].iscsi.OFMarker = No
Nov 30 11:01:13 user nova-compute[75020]: # END RECORD
Nov 30 11:01:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0a60f-f693-49d1-b6e6-370714d13e20]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8391c1-4fd3-4879-81de-c307dc91a3c5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtHYEywf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtHYEywf" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a1f69f-a9e1-4e5b-bf31-23a0a71cf99d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VtHYEywf'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[33494b81-1d30-4d9e-9b4e-6037054b5182]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eb14c5-1e80-4581-9990-caf3aa6751c6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:13 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6713e7c9-df6e-495e-9cb1-a5e806a8f0cb]: (4, ('0 0 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtHYEywf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23863646337333437', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863646337333437', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'flavor' on Instance uuid e135a295-5025-4013-bb21-634a2837f0d8 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-745636477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-745636477',id=27,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:59:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-cttz0m7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T10:59:45Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=492f3123-e679-4a6c-a134-6c7912054463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "vif_mac": "fa:16:3e:94:99:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "vif_mac": "fa:16:3e:94:99:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:99:3d,bridge_name='br-int',has_traffic_filtering=True,id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c71a3-cf') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.objects.instance [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'pci_devices' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.objects.base [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Object Instance<492f3123-e679-4a6c-a134-6c7912054463> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:01:13 user nova-compute[75020]:   <uuid>492f3123-e679-4a6c-a134-6c7912054463</uuid>
Nov 30 11:01:13 user nova-compute[75020]:   <name>instance-0000001b</name>
Nov 30 11:01:13 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:01:13 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:01:13 user nova-compute[75020]:   <metadata>
Nov 30 11:01:13 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:01:13 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:01:13 user nova-compute[75020]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-745636477</nova:name>
Nov 30 11:01:13 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:01:12</nova:creationTime>
Nov 30 11:01:13 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:01:13 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:01:13 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:01:13 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:01:13 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:01:13 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:01:13 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:01:13 user nova-compute[75020]:       <nova:owner>
Nov 30 11:01:13 user nova-compute[75020]:         <nova:user uuid="a93ae25dec664c44ba88b0f15f6a239e">tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member</nova:user>
Nov 30 11:01:13 user nova-compute[75020]:         <nova:project uuid="e02acda28c914dcdaa8afa65411b8055">tempest-ServerBootFromVolumeStableRescueTest-548019548</nova:project>
Nov 30 11:01:13 user nova-compute[75020]:       </nova:owner>
Nov 30 11:01:13 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:01:13 user nova-compute[75020]:       <nova:ports>
Nov 30 11:01:13 user nova-compute[75020]:         <nova:port uuid="5f3c71a3-cf0b-4895-a021-ef8d3969b3b0">
Nov 30 11:01:13 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 11:01:13 user nova-compute[75020]:         </nova:port>
Nov 30 11:01:13 user nova-compute[75020]:       </nova:ports>
Nov 30 11:01:13 user nova-compute[75020]:     </nova:instance>
Nov 30 11:01:13 user nova-compute[75020]:   </metadata>
Nov 30 11:01:13 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:01:13 user nova-compute[75020]:     <system>
Nov 30 11:01:13 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:01:13 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:01:13 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:01:13 user nova-compute[75020]:       <entry name="serial">492f3123-e679-4a6c-a134-6c7912054463</entry>
Nov 30 11:01:13 user nova-compute[75020]:       <entry name="uuid">492f3123-e679-4a6c-a134-6c7912054463</entry>
Nov 30 11:01:13 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:01:13 user nova-compute[75020]:     </system>
Nov 30 11:01:13 user nova-compute[75020]:   </sysinfo>
Nov 30 11:01:13 user nova-compute[75020]:   <os>
Nov 30 11:01:13 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:01:13 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:01:13 user nova-compute[75020]:   </os>
Nov 30 11:01:13 user nova-compute[75020]:   <features>
Nov 30 11:01:13 user nova-compute[75020]:     <acpi/>
Nov 30 11:01:13 user nova-compute[75020]:     <apic/>
Nov 30 11:01:13 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:01:13 user nova-compute[75020]:   </features>
Nov 30 11:01:13 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:01:13 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:01:13 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:01:13 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:01:13 user nova-compute[75020]:   </clock>
Nov 30 11:01:13 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:01:13 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:01:13 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:01:13 user nova-compute[75020]:   </cpu>
Nov 30 11:01:13 user nova-compute[75020]:   <devices>
Nov 30 11:01:13 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:01:13 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:13 user nova-compute[75020]:       <source dev="/dev/sdd"/>
Nov 30 11:01:13 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:01:13 user nova-compute[75020]:       <serial>b258d561-61a3-4f4a-8731-f7bf0f714e15</serial>
Nov 30 11:01:13 user nova-compute[75020]:     </disk>
Nov 30 11:01:13 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:01:13 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:01:13 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue"/>
Nov 30 11:01:13 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 11:01:13 user nova-compute[75020]:       <boot order="1"/>
Nov 30 11:01:13 user nova-compute[75020]:     </disk>
Nov 30 11:01:13 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:01:13 user nova-compute[75020]:       <mac address="fa:16:3e:94:99:3d"/>
Nov 30 11:01:13 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:01:13 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:01:13 user nova-compute[75020]:       <target dev="tap5f3c71a3-cf"/>
Nov 30 11:01:13 user nova-compute[75020]:     </interface>
Nov 30 11:01:13 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:01:13 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/console.log" append="off"/>
Nov 30 11:01:13 user nova-compute[75020]:     </serial>
Nov 30 11:01:13 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:01:13 user nova-compute[75020]:     <video>
Nov 30 11:01:13 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:01:13 user nova-compute[75020]:     </video>
Nov 30 11:01:13 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:01:13 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:01:13 user nova-compute[75020]:     </rng>
Nov 30 11:01:13 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:01:13 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:01:13 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:01:13 user nova-compute[75020]:     </memballoon>
Nov 30 11:01:13 user nova-compute[75020]:   </devices>
Nov 30 11:01:13 user nova-compute[75020]: </domain>
Nov 30 11:01:13 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:01:13 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance destroyed successfully.
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] No VIF found with MAC fa:16:3e:94:99:3d, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:13 user nova-compute[75020]: INFO nova.compute.manager [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Attaching volume db13725a-4e88-4571-ab46-863256f97f5e to /dev/vdb
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.utils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[547a2e18-9008-40d3-ba65-4e3e7883585f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af65aae-fd86-4194-9de2-bc71cc98d3b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a718233d-c4c4-4b51-bc74-ab6f5bbc6e9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[04002522-7bdd-4802-8cf5-9ffd80e8dc41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:01:13 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:01:13 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f55158c-ce0b-4cbe-b2a7-9b59f1239d8e]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG os_brick.utils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:13 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updating existing volume attachment record: a71f5875-8577-4a71-887b-eeb8b21c8555 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-5ff442cc-df9b-48fa-ad38-907c13874e42 req-9e9b9760-d012-440c-90c2-bb546d4ca4cc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ff442cc-df9b-48fa-ad38-907c13874e42 req-9e9b9760-d012-440c-90c2-bb546d4ca4cc service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ff442cc-df9b-48fa-ad38-907c13874e42 req-9e9b9760-d012-440c-90c2-bb546d4ca4cc service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5ff442cc-df9b-48fa-ad38-907c13874e42 req-9e9b9760-d012-440c-90c2-bb546d4ca4cc service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-5ff442cc-df9b-48fa-ad38-907c13874e42 req-9e9b9760-d012-440c-90c2-bb546d4ca4cc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:14 user nova-compute[75020]: WARNING nova.compute.manager [req-5ff442cc-df9b-48fa-ad38-907c13874e42 req-9e9b9760-d012-440c-90c2-bb546d4ca4cc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state active and task_state rescuing.
Nov 30 11:01:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-8e938e7a-a49f-4663-9940-206f415e7bfe req-15f12426-6756-40d3-a210-255cfe2fa43d service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-changed-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-8e938e7a-a49f-4663-9940-206f415e7bfe req-15f12426-6756-40d3-a210-255cfe2fa43d service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Refreshing instance network info cache due to event network-changed-a3626203-1d0f-4d96-bf21-796358c11fd2. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8e938e7a-a49f-4663-9940-206f415e7bfe req-15f12426-6756-40d3-a210-255cfe2fa43d service nova] Acquiring lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8e938e7a-a49f-4663-9940-206f415e7bfe req-15f12426-6756-40d3-a210-255cfe2fa43d service nova] Acquired lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-8e938e7a-a49f-4663-9940-206f415e7bfe req-15f12426-6756-40d3-a210-255cfe2fa43d service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Refreshing network info cache for port a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-dd146225-3cbf-4916-95e0-2ddfc5ffd555 req-2a426446-0a5f-466c-a2e9-3368706c91d0 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dd146225-3cbf-4916-95e0-2ddfc5ffd555 req-2a426446-0a5f-466c-a2e9-3368706c91d0 service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dd146225-3cbf-4916-95e0-2ddfc5ffd555 req-2a426446-0a5f-466c-a2e9-3368706c91d0 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dd146225-3cbf-4916-95e0-2ddfc5ffd555 req-2a426446-0a5f-466c-a2e9-3368706c91d0 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-dd146225-3cbf-4916-95e0-2ddfc5ffd555 req-2a426446-0a5f-466c-a2e9-3368706c91d0 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:17 user nova-compute[75020]: WARNING nova.compute.manager [req-dd146225-3cbf-4916-95e0-2ddfc5ffd555 req-2a426446-0a5f-466c-a2e9-3368706c91d0 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state active and task_state rescuing.
Nov 30 11:01:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-6c76da54-4fe5-4f08-b053-19b4231f4b1a tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-8e938e7a-a49f-4663-9940-206f415e7bfe req-15f12426-6756-40d3-a210-255cfe2fa43d service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updated VIF entry in instance network info cache for port a3626203-1d0f-4d96-bf21-796358c11fd2. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG nova.network.neutron [req-8e938e7a-a49f-4663-9940-206f415e7bfe req-15f12426-6756-40d3-a210-255cfe2fa43d service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updating instance_info_cache with network_info: [{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8e938e7a-a49f-4663-9940-206f415e7bfe req-15f12426-6756-40d3-a210-255cfe2fa43d service nova] Releasing lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-e241691f-85f9-4e0e-85b0-d9928f9da170 req-29c15c69-3e1d-426e-86cc-d4d5f3e3afaa service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-changed-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-e241691f-85f9-4e0e-85b0-d9928f9da170 req-29c15c69-3e1d-426e-86cc-d4d5f3e3afaa service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Refreshing instance network info cache due to event network-changed-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e241691f-85f9-4e0e-85b0-d9928f9da170 req-29c15c69-3e1d-426e-86cc-d4d5f3e3afaa service nova] Acquiring lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e241691f-85f9-4e0e-85b0-d9928f9da170 req-29c15c69-3e1d-426e-86cc-d4d5f3e3afaa service nova] Acquired lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-e241691f-85f9-4e0e-85b0-d9928f9da170 req-29c15c69-3e1d-426e-86cc-d4d5f3e3afaa service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Refreshing network info cache for port fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Stashing vm_state: active {{(pid=75020) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-e241691f-85f9-4e0e-85b0-d9928f9da170 req-29c15c69-3e1d-426e-86cc-d4d5f3e3afaa service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updated VIF entry in instance network info cache for port fd39b8a9-8223-43c9-9fa3-9b4bc9461edf. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-e241691f-85f9-4e0e-85b0-d9928f9da170 req-29c15c69-3e1d-426e-86cc-d4d5f3e3afaa service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating instance_info_cache with network_info: [{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e241691f-85f9-4e0e-85b0-d9928f9da170 req-29c15c69-3e1d-426e-86cc-d4d5f3e3afaa service nova] Releasing lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:01:19 user nova-compute[75020]: INFO nova.compute.claims [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Claim successful on node user
Nov 30 11:01:20 user nova-compute[75020]: INFO nova.compute.resource_tracker [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating resource usage from migration 0027eed6-4b02-4221-b8b4-88e5e7f9343c
Nov 30 11:01:20 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:01:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:01:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.584s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:20 user nova-compute[75020]: INFO nova.compute.manager [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Migrating
Nov 30 11:01:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:20 user nova-compute[75020]: INFO nova.compute.rpcapi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 30 11:01:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquired lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:20 user nova-compute[75020]: DEBUG nova.network.neutron [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating instance_info_cache with network_info: [{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Releasing lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Starting migrate_disk_and_power_off {{(pid=75020) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-c48f3368-2f3f-443f-8847-760b8f7ff9ec req-4a2dc6a9-fd6e-4834-b4ce-c37727ef7200 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c48f3368-2f3f-443f-8847-760b8f7ff9ec req-4a2dc6a9-fd6e-4834-b4ce-c37727ef7200 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c48f3368-2f3f-443f-8847-760b8f7ff9ec req-4a2dc6a9-fd6e-4834-b4ce-c37727ef7200 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c48f3368-2f3f-443f-8847-760b8f7ff9ec req-4a2dc6a9-fd6e-4834-b4ce-c37727ef7200 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-c48f3368-2f3f-443f-8847-760b8f7ff9ec req-4a2dc6a9-fd6e-4834-b4ce-c37727ef7200 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:21 user nova-compute[75020]: WARNING nova.compute.manager [req-c48f3368-2f3f-443f-8847-760b8f7ff9ec req-4a2dc6a9-fd6e-4834-b4ce-c37727ef7200 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state active and task_state resize_migrating.
Nov 30 11:01:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance destroyed successfully.
Nov 30 11:01:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092003400',display_name='tempest-ServerActionsTestOtherA-server-1092003400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092003400',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-m0a6tv5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:01:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=79fe1d49-08c7-4197-a6b6-7f7dc4500487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-830753088-network", "vif_mac": "fa:16:3e:fa:03:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-830753088-network", "vif_mac": "fa:16:3e:fa:03:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_vif [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd39b8a9-82, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7563f04-83be-4442-a5f2-3b479211fbf1) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:01:22 user nova-compute[75020]: INFO os_vif [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82')
Nov 30 11:01:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVAphqHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:22 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb1b96d-0893-43bc-ab77-1970d49cf23a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:01:22 user nova-compute[75020]: No targets found.
Nov 30 11:01:22 user nova-compute[75020]: iSNS:
Nov 30 11:01:22 user nova-compute[75020]: No targets found.
Nov 30 11:01:22 user nova-compute[75020]: STATIC:
Nov 30 11:01:22 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06
Nov 30 11:01:22 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:22 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:22 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead
Nov 30 11:01:22 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:22 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:22 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629
Nov 30 11:01:22 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:22 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:22 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15
Nov 30 11:01:22 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:22 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:22 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4
Nov 30 11:01:22 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:22 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:22 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:01:22 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:22 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:22 user nova-compute[75020]: FIRMWARE:
Nov 30 11:01:22 user nova-compute[75020]: No targets found.
Nov 30 11:01:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:01:22 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:01:22 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81c254a-e78f-4bbd-9a26-614933eabae5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d508e5b7-6833-4154-9d08-efde1fedda4d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad885ffbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb803be-31c9-4b1a-ada6-97f999f3bf69]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[81caf129-93f5-4a51-91e9-6257075867a1]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15fade9-52d7-47dd-85cd-7d98aff919bc]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ac4dd0-5a8b-4c40-88ea-4573e02bc6a3]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a57899-caca-4b76-8996-ee286267744f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef5873f-20fd-46ad-8d6c-ddce47feae27]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260]
Nov 30 11:01:22 user nova-compute[75020]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260] successful.
Nov 30 11:01:22 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[df38bd2c-dfec-4769-9584-b1f4e34d93a0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== disconnect_volume: return (398ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:01:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:01:23 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61543d0a-92b8-4276-8301-4620468f0189 is timed out.
Nov 30 11:01:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully detached device vdb from instance 61543d0a-92b8-4276-8301-4620468f0189 from the live domain config.
Nov 30 11:01:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTpZHajR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:23 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ffc0a6-3e9b-4c89-b134-88ef1ca8f5fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:01:23 user nova-compute[75020]: No targets found.
Nov 30 11:01:23 user nova-compute[75020]: iSNS:
Nov 30 11:01:23 user nova-compute[75020]: No targets found.
Nov 30 11:01:23 user nova-compute[75020]: STATIC:
Nov 30 11:01:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06
Nov 30 11:01:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629
Nov 30 11:01:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15
Nov 30 11:01:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4
Nov 30 11:01:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:23 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:01:23 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:23 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:23 user nova-compute[75020]: FIRMWARE:
Nov 30 11:01:23 user nova-compute[75020]: No targets found.
Nov 30 11:01:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:01:23 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:01:23 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a4db13-9f4a-4105-981e-21b7c6e6ced3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263f347-98d7-4562-a762-c1e1c7e565f5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada84acc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee655a0-a812-4182-8fd5-e737a05308c0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-13f71720-7cf8-4f2a-87dd-3b24d0fd5dcc req-4c969070-55a0-4ec5-a69f-b5151543eb43 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-13f71720-7cf8-4f2a-87dd-3b24d0fd5dcc req-4c969070-55a0-4ec5-a69f-b5151543eb43 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-13f71720-7cf8-4f2a-87dd-3b24d0fd5dcc req-4c969070-55a0-4ec5-a69f-b5151543eb43 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-13f71720-7cf8-4f2a-87dd-3b24d0fd5dcc req-4c969070-55a0-4ec5-a69f-b5151543eb43 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-13f71720-7cf8-4f2a-87dd-3b24d0fd5dcc req-4c969070-55a0-4ec5-a69f-b5151543eb43 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:23 user nova-compute[75020]: WARNING nova.compute.manager [req-13f71720-7cf8-4f2a-87dd-3b24d0fd5dcc req-4c969070-55a0-4ec5-a69f-b5151543eb43 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state active and task_state resize_migrating.
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a1547-ff8d-4757-94db-85d1e86345fc]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b6f741-688b-4ad7-b314-842ca22c4a77]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[656790d0-59eb-4624-957a-560907a69c37]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbc54a1-0f10-4bb5-a625-e2db39d15a02]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3e11c-e26d-4bee-9401-0a024026ca64]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629, portal: 172.16.0.220,3260]
Nov 30 11:01:23 user nova-compute[75020]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629, portal: 172.16.0.220,3260] successful.
Nov 30 11:01:23 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82381e4b-310f-4186-a9d0-b0fab67d6629 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e60e81-7b27-4cac-8e9a-92825c988712]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== disconnect_volume: return (348ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Port fd39b8a9-8223-43c9-9fa3-9b4bc9461edf binding to destination host user is already ACTIVE {{(pid=75020) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquired lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufJNsRnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:24 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e4b7e-edb5-49c6-a938-02c1d4db82c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:01:24 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f9a28e-d186-456d-af87-def27f8c2371]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e] added
Nov 30 11:01:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcb9fe4-2655-4743-bfa3-128b3e458a82]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64675da-9e22-460f-b238-d4c4d917d67c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufJNsRnx {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufJNsRnx" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[228321a5-6c1e-4e0c-9647-7bd83e6c053f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ufJNsRnx'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee13dac7-7576-4984-94a8-6e76c1c9fff2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b50113-9d8b-4fcf-8b47-007f6ba3738b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32d9e9b-2a5a-41e7-8727-8128005cb477]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e, portal: 172.16.0.220,3260]
Nov 30 11:01:24 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e, portal: 172.16.0.220,3260] successful.
Nov 30 11:01:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6ca637-dd51-42c4-8fb0-2194e08c008d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e39fff0-79a7-48ae-b4a8-9d1246da8dd1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:24 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ce153-d6bf-4c97-9e49-a724be2f1a37]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufJNsRnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating instance_info_cache with network_info: [{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG nova.objects.instance [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Releasing lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-62517bff-81d6-492c-9cff-adc3297500fd tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.937s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG os_brick.utils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0345f94-1492-48cf-bbf0-f2d24a629f25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8342d2e8-73a9-4592-963d-2e15244c3bdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f92a5-3c0b-4bd5-b711-ab8ff5bda52f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1485a9-55fa-4364-91b7-b5566b20a5bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:01:25 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb4635e-a27a-473d-96c8-da59584fc2ad]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG os_brick.utils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:25 user nova-compute[75020]: INFO nova.compute.manager [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Detaching volume fb1d3e01-9e58-4ccb-97d6-615473c84dd4
Nov 30 11:01:25 user nova-compute[75020]: INFO nova.virt.block_device [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Attempting to driver detach volume fb1d3e01-9e58-4ccb-97d6-615473c84dd4 from mountpoint /dev/vdc
Nov 30 11:01:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Attempting to detach device vdc from instance 61543d0a-92b8-4276-8301-4620468f0189 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:01:25 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:25 user nova-compute[75020]:   <source dev="/dev/sdg"/>
Nov 30 11:01:25 user nova-compute[75020]:   <target dev="vdc" bus="virtio"/>
Nov 30 11:01:25 user nova-compute[75020]:   <serial>fb1d3e01-9e58-4ccb-97d6-615473c84dd4</serial>
Nov 30 11:01:25 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 11:01:25 user nova-compute[75020]: </disk>
Nov 30 11:01:25 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:01:25 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully detached device vdc from instance 61543d0a-92b8-4276-8301-4620468f0189 from the persistent domain config.
Nov 30 11:01:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 61543d0a-92b8-4276-8301-4620468f0189 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:01:25 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:25 user nova-compute[75020]:   <source dev="/dev/sdg"/>
Nov 30 11:01:25 user nova-compute[75020]:   <target dev="vdc" bus="virtio"/>
Nov 30 11:01:25 user nova-compute[75020]:   <serial>fb1d3e01-9e58-4ccb-97d6-615473c84dd4</serial>
Nov 30 11:01:25 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 11:01:25 user nova-compute[75020]: </disk>
Nov 30 11:01:25 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26430616233626434', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430616233626434', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'flavor' on Instance uuid e135a295-5025-4013-bb21-634a2837f0d8 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:01:25 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:25 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:01:25 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:01:25 user nova-compute[75020]:   <serial>db13725a-4e88-4571-ab46-863256f97f5e</serial>
Nov 30 11:01:25 user nova-compute[75020]: </disk>
Nov 30 11:01:25 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:01:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:01:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:01:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:01:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] No VIF found with MAC fa:16:3e:f1:b0:c5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:01:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cf5738bd-9704-4fcb-a9e3-b9a004d75faf tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.851s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:27 user nova-compute[75020]: INFO nova.compute.manager [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Detaching volume db13725a-4e88-4571-ab46-863256f97f5e
Nov 30 11:01:28 user nova-compute[75020]: INFO nova.virt.block_device [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Attempting to driver detach volume db13725a-4e88-4571-ab46-863256f97f5e from mountpoint /dev/vdb
Nov 30 11:01:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Attempting to detach device vdb from instance e135a295-5025-4013-bb21-634a2837f0d8 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:01:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:01:28 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:28 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:01:28 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:01:28 user nova-compute[75020]:   <serial>db13725a-4e88-4571-ab46-863256f97f5e</serial>
Nov 30 11:01:28 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:01:28 user nova-compute[75020]: </disk>
Nov 30 11:01:28 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:01:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Successfully detached device vdb from instance e135a295-5025-4013-bb21-634a2837f0d8 from the persistent domain config.
Nov 30 11:01:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e135a295-5025-4013-bb21-634a2837f0d8 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:01:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:01:28 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:28 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:01:28 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:01:28 user nova-compute[75020]:   <serial>db13725a-4e88-4571-ab46-863256f97f5e</serial>
Nov 30 11:01:28 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:01:28 user nova-compute[75020]: </disk>
Nov 30 11:01:28 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:01:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e135a295-5025-4013-bb21-634a2837f0d8 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:01:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Starting finish_migration {{(pid=75020) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance directory exists: not creating {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 11:01:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Creating image(s)
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Ensure instance console log exists: /opt/stack/data/nova/instances/79fe1d49-08c7-4197-a6b6-7f7dc4500487/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Start _get_guest_xml network_info=[{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-830753088-network", "vif_mac": "fa:16:3e:fa:03:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '835a6a4b-1d26-4f78-8b27-9c9004c66257', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVAphqHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '79fe1d49-08c7-4197-a6b6-7f7dc4500487', 'attached_at': '2023-11-30T11:01:36.000000', 'detached_at': '', 'volume_id': '948eb37d-9bff-42a3-92a5-0a1c41198ead', 'serial': '948eb37d-9bff-42a3-92a5-0a1c41198ead'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:01:35 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:01:35 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVAphqHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:35 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:35 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:35 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f858ba1d-3be7-45a2-8e96-1a9cdc318874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:01:35 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba475a-e682-40f9-a225-0ae216fd1ade]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead] added
Nov 30 11:01:35 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5345b01b-3a64-42ff-97cc-aaefc6b9cd74]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f1b3d-19b7-4e5c-88ce-30eec6edfcdc]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVAphqHn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVAphqHn" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef2eceb-1a27-4fd1-9920-4a0d6316fb42]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:35 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVAphqHn'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f674e85f-016b-4267-a9dc-5c457050c584]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacdfb29-3e7f-456b-a3e5-d7d1be21c47e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8eb685-e77e-4857-979b-df409c64b0e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260]
Nov 30 11:01:36 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260] successful.
Nov 30 11:01:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9ba203-3411-4378-a601-f7e01204fc10]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[523f3c3f-432f-4f5b-a386-60f452fe0fc7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:36 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[83195f7d-8342-4126-9d85-bd45f487f95f]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:01:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVAphqHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23733336239666132', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733336239666132', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092003400',display_name='tempest-ServerActionsTestOtherA-server-1092003400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092003400',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-m0a6tv5a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:01:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=79fe1d49-08c7-4197-a6b6-7f7dc4500487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-830753088-network", "vif_mac": "fa:16:3e:fa:03:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-830753088-network", "vif_mac": "fa:16:3e:fa:03:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:01:37 user nova-compute[75020]:   <uuid>79fe1d49-08c7-4197-a6b6-7f7dc4500487</uuid>
Nov 30 11:01:37 user nova-compute[75020]:   <name>instance-0000001d</name>
Nov 30 11:01:37 user nova-compute[75020]:   <memory>2097152</memory>
Nov 30 11:01:37 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:01:37 user nova-compute[75020]:   <metadata>
Nov 30 11:01:37 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:01:37 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:01:37 user nova-compute[75020]:       <nova:name>tempest-ServerActionsTestOtherA-server-1092003400</nova:name>
Nov 30 11:01:37 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:01:35</nova:creationTime>
Nov 30 11:01:37 user nova-compute[75020]:       <nova:flavor name="m1.small">
Nov 30 11:01:37 user nova-compute[75020]:         <nova:memory>2048</nova:memory>
Nov 30 11:01:37 user nova-compute[75020]:         <nova:disk>20</nova:disk>
Nov 30 11:01:37 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:01:37 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:01:37 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:01:37 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:01:37 user nova-compute[75020]:       <nova:owner>
Nov 30 11:01:37 user nova-compute[75020]:         <nova:user uuid="7f64ef255b2a48349a280bf3693af23f">tempest-ServerActionsTestOtherA-582760806-project-member</nova:user>
Nov 30 11:01:37 user nova-compute[75020]:         <nova:project uuid="e10919b523b740859f3ac98e31468a93">tempest-ServerActionsTestOtherA-582760806</nova:project>
Nov 30 11:01:37 user nova-compute[75020]:       </nova:owner>
Nov 30 11:01:37 user nova-compute[75020]:       <nova:ports>
Nov 30 11:01:37 user nova-compute[75020]:         <nova:port uuid="fd39b8a9-8223-43c9-9fa3-9b4bc9461edf">
Nov 30 11:01:37 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 11:01:37 user nova-compute[75020]:         </nova:port>
Nov 30 11:01:37 user nova-compute[75020]:       </nova:ports>
Nov 30 11:01:37 user nova-compute[75020]:     </nova:instance>
Nov 30 11:01:37 user nova-compute[75020]:   </metadata>
Nov 30 11:01:37 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:01:37 user nova-compute[75020]:     <system>
Nov 30 11:01:37 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:01:37 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:01:37 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:01:37 user nova-compute[75020]:       <entry name="serial">79fe1d49-08c7-4197-a6b6-7f7dc4500487</entry>
Nov 30 11:01:37 user nova-compute[75020]:       <entry name="uuid">79fe1d49-08c7-4197-a6b6-7f7dc4500487</entry>
Nov 30 11:01:37 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:01:37 user nova-compute[75020]:     </system>
Nov 30 11:01:37 user nova-compute[75020]:   </sysinfo>
Nov 30 11:01:37 user nova-compute[75020]:   <os>
Nov 30 11:01:37 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:01:37 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:01:37 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:01:37 user nova-compute[75020]:   </os>
Nov 30 11:01:37 user nova-compute[75020]:   <features>
Nov 30 11:01:37 user nova-compute[75020]:     <acpi/>
Nov 30 11:01:37 user nova-compute[75020]:     <apic/>
Nov 30 11:01:37 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:01:37 user nova-compute[75020]:   </features>
Nov 30 11:01:37 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:01:37 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:01:37 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:01:37 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:01:37 user nova-compute[75020]:   </clock>
Nov 30 11:01:37 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:01:37 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:01:37 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:01:37 user nova-compute[75020]:   </cpu>
Nov 30 11:01:37 user nova-compute[75020]:   <devices>
Nov 30 11:01:37 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:01:37 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:01:37 user nova-compute[75020]:       <source dev="/dev/sde"/>
Nov 30 11:01:37 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:01:37 user nova-compute[75020]:       <serial>948eb37d-9bff-42a3-92a5-0a1c41198ead</serial>
Nov 30 11:01:37 user nova-compute[75020]:     </disk>
Nov 30 11:01:37 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:01:37 user nova-compute[75020]:       <mac address="fa:16:3e:fa:03:52"/>
Nov 30 11:01:37 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:01:37 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:01:37 user nova-compute[75020]:       <target dev="tapfd39b8a9-82"/>
Nov 30 11:01:37 user nova-compute[75020]:     </interface>
Nov 30 11:01:37 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:01:37 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/79fe1d49-08c7-4197-a6b6-7f7dc4500487/console.log" append="off"/>
Nov 30 11:01:37 user nova-compute[75020]:     </serial>
Nov 30 11:01:37 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:01:37 user nova-compute[75020]:     <video>
Nov 30 11:01:37 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:01:37 user nova-compute[75020]:     </video>
Nov 30 11:01:37 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:01:37 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:01:37 user nova-compute[75020]:     </rng>
Nov 30 11:01:37 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:01:37 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:01:37 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:01:37 user nova-compute[75020]:     </memballoon>
Nov 30 11:01:37 user nova-compute[75020]:   </devices>
Nov 30 11:01:37 user nova-compute[75020]: </domain>
Nov 30 11:01:37 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092003400',display_name='tempest-ServerActionsTestOtherA-server-1092003400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092003400',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-m0a6tv5a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:01:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=79fe1d49-08c7-4197-a6b6-7f7dc4500487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-830753088-network", "vif_mac": "fa:16:3e:fa:03:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-830753088-network", "vif_mac": "fa:16:3e:fa:03:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG os_vif [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4755606b-61b8-5f9f-957d-fb8ac1529008', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd39b8a9-82, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd39b8a9-82, col_values=(('qos', UUID('f5181264-ccfc-4ba2-8a0f-c84ba6ce55dc')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd39b8a9-82, col_values=(('external_ids', {'iface-id': 'fd39b8a9-8223-43c9-9fa3-9b4bc9461edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:03:52', 'vm-uuid': '79fe1d49-08c7-4197-a6b6-7f7dc4500487'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:37 user nova-compute[75020]: INFO os_vif [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82')
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:01:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] No VIF found with MAC fa:16:3e:fa:03:52, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:01:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:38 user nova-compute[75020]: INFO nova.compute.manager [None req-b4a0c967-9aec-4074-9a55-2c7ec05ac9f3 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Unrescuing
Nov 30 11:01:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b4a0c967-9aec-4074-9a55-2c7ec05ac9f3 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b4a0c967-9aec-4074-9a55-2c7ec05ac9f3 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquired lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:38 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b4a0c967-9aec-4074-9a55-2c7ec05ac9f3 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:01:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb2cb2c0-2ef5-4f78-bb88-726d65ea1415 req-9ea4bde9-00d7-4b2f-a77c-687c5cdf5062 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb2cb2c0-2ef5-4f78-bb88-726d65ea1415 req-9ea4bde9-00d7-4b2f-a77c-687c5cdf5062 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb2cb2c0-2ef5-4f78-bb88-726d65ea1415 req-9ea4bde9-00d7-4b2f-a77c-687c5cdf5062 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb2cb2c0-2ef5-4f78-bb88-726d65ea1415 req-9ea4bde9-00d7-4b2f-a77c-687c5cdf5062 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb2cb2c0-2ef5-4f78-bb88-726d65ea1415 req-9ea4bde9-00d7-4b2f-a77c-687c5cdf5062 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:39 user nova-compute[75020]: WARNING nova.compute.manager [req-eb2cb2c0-2ef5-4f78-bb88-726d65ea1415 req-9ea4bde9-00d7-4b2f-a77c-687c5cdf5062 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state active and task_state resize_finish.
Nov 30 11:01:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-b4a0c967-9aec-4074-9a55-2c7ec05ac9f3 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updating instance_info_cache with network_info: [{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-b4a0c967-9aec-4074-9a55-2c7ec05ac9f3 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Releasing lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-b4a0c967-9aec-4074-9a55-2c7ec05ac9f3 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'flavor' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-decfe907-f9c3-4d1a-899d-9d4950048682 req-b23d1b8a-9228-4339-940e-901906c551f2 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-decfe907-f9c3-4d1a-899d-9d4950048682 req-b23d1b8a-9228-4339-940e-901906c551f2 service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-decfe907-f9c3-4d1a-899d-9d4950048682 req-b23d1b8a-9228-4339-940e-901906c551f2 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-decfe907-f9c3-4d1a-899d-9d4950048682 req-b23d1b8a-9228-4339-940e-901906c551f2 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-decfe907-f9c3-4d1a-899d-9d4950048682 req-b23d1b8a-9228-4339-940e-901906c551f2 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:40 user nova-compute[75020]: WARNING nova.compute.manager [req-decfe907-f9c3-4d1a-899d-9d4950048682 req-b23d1b8a-9228-4339-940e-901906c551f2 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:01:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance destroyed successfully.
Nov 30 11:01:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-63e6a5bc-cabc-48bb-b686-c52a01017c1c req-a40fb386-bbe8-45d4-b10b-0a90836b408d service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-63e6a5bc-cabc-48bb-b686-c52a01017c1c req-a40fb386-bbe8-45d4-b10b-0a90836b408d service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-63e6a5bc-cabc-48bb-b686-c52a01017c1c req-a40fb386-bbe8-45d4-b10b-0a90836b408d service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-63e6a5bc-cabc-48bb-b686-c52a01017c1c req-a40fb386-bbe8-45d4-b10b-0a90836b408d service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-63e6a5bc-cabc-48bb-b686-c52a01017c1c req-a40fb386-bbe8-45d4-b10b-0a90836b408d service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:41 user nova-compute[75020]: WARNING nova.compute.manager [req-63e6a5bc-cabc-48bb-b686-c52a01017c1c req-a40fb386-bbe8-45d4-b10b-0a90836b408d service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state active and task_state resize_finish.
Nov 30 11:01:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:01:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance running successfully.
Nov 30 11:01:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Failed to set time: agent not configured {{(pid=75020) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 11:01:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-658feb5e-3da3-4c55-b699-f0ad8dc5e90f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] finish_migration finished successfully. {{(pid=75020) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 30 11:01:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-f27bda7d-0a62-4aba-a72f-caf39a2e2c4c req-fc011c68-b976-4839-97af-2a4dc9060ceb service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f27bda7d-0a62-4aba-a72f-caf39a2e2c4c req-fc011c68-b976-4839-97af-2a4dc9060ceb service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f27bda7d-0a62-4aba-a72f-caf39a2e2c4c req-fc011c68-b976-4839-97af-2a4dc9060ceb service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f27bda7d-0a62-4aba-a72f-caf39a2e2c4c req-fc011c68-b976-4839-97af-2a4dc9060ceb service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-f27bda7d-0a62-4aba-a72f-caf39a2e2c4c req-fc011c68-b976-4839-97af-2a4dc9060ceb service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:42 user nova-compute[75020]: WARNING nova.compute.manager [req-f27bda7d-0a62-4aba-a72f-caf39a2e2c4c req-fc011c68-b976-4839-97af-2a4dc9060ceb service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:01:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:44 user nova-compute[75020]: WARNING nova.compute.manager [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:01:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:44 user nova-compute[75020]: WARNING nova.compute.manager [req-5f54f0a7-193b-4a87-8b48-3d610c98b8c1 req-1a6a6164-58dc-46fd-a020-d04035c5bfd7 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:01:44 user nova-compute[75020]: DEBUG nova.compute.manager [None req-b4a0c967-9aec-4074-9a55-2c7ec05ac9f3 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:46 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 61543d0a-92b8-4276-8301-4620468f0189 is timed out.
Nov 30 11:01:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully detached device vdc from instance 61543d0a-92b8-4276-8301-4620468f0189 from the live domain config.
Nov 30 11:01:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcBfUGAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:46 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08796d1-4858-426e-a09d-fed89aec06f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:01:46 user nova-compute[75020]: No targets found.
Nov 30 11:01:46 user nova-compute[75020]: iSNS:
Nov 30 11:01:46 user nova-compute[75020]: No targets found.
Nov 30 11:01:46 user nova-compute[75020]: STATIC:
Nov 30 11:01:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06
Nov 30 11:01:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead
Nov 30 11:01:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e
Nov 30 11:01:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15
Nov 30 11:01:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4
Nov 30 11:01:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:46 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:01:46 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:46 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:46 user nova-compute[75020]: FIRMWARE:
Nov 30 11:01:46 user nova-compute[75020]: No targets found.
Nov 30 11:01:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:01:46 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:01:46 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38f7c0d-da66-4172-b9b5-c6dd2f5809a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a08dfa8-bc0b-41b2-abc6-819fd0ca505b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:46 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad885fe290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4'): ({'sdg'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Removing single pathed devices sdg {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffb1da0-fbae-4635-821e-40258c4ae801]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9279ef8-2bc0-4a64-8e4f-a857f144a52f]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Flushing IO for device /dev/sdg {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f73c6cf-c7d0-4a2b-8bf0-19aa69aaeec5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[053a1249-23a5-44dd-8717-30f5cd45523a]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] SCSI volumes sdg have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ae77a-78d6-40b3-b78f-e879b67252bb]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a04a56c-3007-4600-a856-9537d8436611]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4, portal: 172.16.0.220,3260]
Nov 30 11:01:46 user nova-compute[75020]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4, portal: 172.16.0.220,3260] successful.
Nov 30 11:01:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1d3e01-9e58-4ccb-97d6-615473c84dd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[003d4888-da6c-4772-beac-be5fd9914aa2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] <== disconnect_volume: return (423ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:01:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:47 user nova-compute[75020]: DEBUG nova.objects.instance [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'flavor' on Instance uuid 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9f5bf9b7-be00-458e-8528-462ae9aa3493 tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.181s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:48 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e135a295-5025-4013-bb21-634a2837f0d8 is timed out.
Nov 30 11:01:48 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Successfully detached device vdb from instance e135a295-5025-4013-bb21-634a2837f0d8 from the live domain config.
Nov 30 11:01:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufJNsRnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:01:48 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[07afed41-87b1-4a18-84a6-4dfc647e2b98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:01:48 user nova-compute[75020]: No targets found.
Nov 30 11:01:48 user nova-compute[75020]: iSNS:
Nov 30 11:01:48 user nova-compute[75020]: No targets found.
Nov 30 11:01:48 user nova-compute[75020]: STATIC:
Nov 30 11:01:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06
Nov 30 11:01:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead
Nov 30 11:01:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e
Nov 30 11:01:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15
Nov 30 11:01:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:48 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:01:48 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:01:48 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:01:48 user nova-compute[75020]: FIRMWARE:
Nov 30 11:01:48 user nova-compute[75020]: No targets found.
Nov 30 11:01:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:01:48 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:01:48 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba068940-61b8-4ad7-95c0-1786e8998762]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fed85f6-9003-4342-ba9f-c8a17182c062]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:48 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:48 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:48 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:48 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:01:48 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:01:48 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:01:48 user nova-compute[75020]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e (non-flash)
Nov 30 11:01:48 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:01:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad887d5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1cd473-9a6d-403c-a04d-c9190f9f9160]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b1301c-6024-4b94-aca6-42eaf684e63b]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[017259cb-c43c-4aea-a113-5bdc23a2e57e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d92990-5e4f-4b28-b8e3-a011b706e90a]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53d6693-e158-46b3-a088-1f7a6aefd23e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:48 user nova-compute[75020]: INFO nova.compute.manager [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Terminating instance
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dbea4d-6df8-475d-91ae-2d395a764733]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e, portal: 172.16.0.220,3260]
Nov 30 11:01:48 user nova-compute[75020]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e, portal: 172.16.0.220,3260] successful.
Nov 30 11:01:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db13725a-4e88-4571-ab46-863256f97f5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64f6167-6fe3-4b12-b212-b894132188b0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] <== disconnect_volume: return (427ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:01:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-d9cb0b36-1ee4-4962-9192-45a9c5675444 req-341e30d0-1a83-40ec-8c59-0a15d7b8324a service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received event network-vif-unplugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9cb0b36-1ee4-4962-9192-45a9c5675444 req-341e30d0-1a83-40ec-8c59-0a15d7b8324a service nova] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9cb0b36-1ee4-4962-9192-45a9c5675444 req-341e30d0-1a83-40ec-8c59-0a15d7b8324a service nova] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9cb0b36-1ee4-4962-9192-45a9c5675444 req-341e30d0-1a83-40ec-8c59-0a15d7b8324a service nova] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-d9cb0b36-1ee4-4962-9192-45a9c5675444 req-341e30d0-1a83-40ec-8c59-0a15d7b8324a service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] No waiting events found dispatching network-vif-unplugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-d9cb0b36-1ee4-4962-9192-45a9c5675444 req-341e30d0-1a83-40ec-8c59-0a15d7b8324a service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received event network-vif-unplugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Instance destroyed successfully.
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lazy-loading 'resources' on Instance uuid 61543d0a-92b8-4276-8301-4620468f0189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1910170197',display_name='tempest-AttachVolumeTestJSON-server-1910170197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1910170197',id=26,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKujSzC3oZ0MX2KhjmmjEcx5rwT8JLGaLymoesOsVO57fC5FwPnDHGrH4p82/d6lRDT+6bptkz2N9Hv/IUfhTPUCRNMWs8o9toN9yU89dLTRHLhus64qpzVWIBHmRbsGkg==',key_name='tempest-keypair-1535642839',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2765886644e4b5eb42a29eb8c0a82e1',ramdisk_id='',reservation_id='r-0vjft97p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1562861090',owner_user_name='tempest-AttachVolumeTestJSON-1562861090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007e7cb60a1540c0a4168b27b2c92e0b',uuid=61543d0a-92b8-4276-8301-4620468f0189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converting VIF {"id": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "address": "fa:16:3e:f8:aa:f5", "network": {"id": "81e0442d-cbee-45fe-9d4c-23d07ad0da04", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146079444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2765886644e4b5eb42a29eb8c0a82e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088ea6c2-0c", "ovs_interfaceid": "088ea6c2-0c4a-4f91-8464-f9c56da8f397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=088ea6c2-0c4a-4f91-8464-f9c56da8f397,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088ea6c2-0c') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG os_vif [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=088ea6c2-0c4a-4f91-8464-f9c56da8f397,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088ea6c2-0c') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap088ea6c2-0c, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=253c72db-c7a8-4d22-addb-cef6ca15d9bf) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:01:49 user nova-compute[75020]: INFO os_vif [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=088ea6c2-0c4a-4f91-8464-f9c56da8f397,network=Network(81e0442d-cbee-45fe-9d4c-23d07ad0da04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088ea6c2-0c')
Nov 30 11:01:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Deleting instance files /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189_del
Nov 30 11:01:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Deletion of /opt/stack/data/nova/instances/61543d0a-92b8-4276-8301-4620468f0189_del complete
Nov 30 11:01:49 user nova-compute[75020]: INFO nova.compute.manager [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 30 11:01:49 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 61543d0a-92b8-4276-8301-4620468f0189] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:01:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updating instance_info_cache with network_info: [{"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'flavor' on Instance uuid e135a295-5025-4013-bb21-634a2837f0d8 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-1c7e9069-f20d-4389-bbe9-5b3702d408e5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ca5ca0ec-1610-4b30-949b-e9c80807429c tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.113s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:50 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:50 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Took 1.03 seconds to deallocate network for instance.
Nov 30 11:01:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-c6b9412b-1bf7-4009-92c7-0937f9b6714a req-12f9d0cf-81d4-46e3-97ab-9c8ba6c4c60f service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received event network-vif-deleted-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:50 user nova-compute[75020]: INFO nova.compute.manager [req-c6b9412b-1bf7-4009-92c7-0937f9b6714a req-12f9d0cf-81d4-46e3-97ab-9c8ba6c4c60f service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Neutron deleted interface 088ea6c2-0c4a-4f91-8464-f9c56da8f397; detaching it from the instance and deleting it from the info cache
Nov 30 11:01:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-c6b9412b-1bf7-4009-92c7-0937f9b6714a req-12f9d0cf-81d4-46e3-97ab-9c8ba6c4c60f service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-c6b9412b-1bf7-4009-92c7-0937f9b6714a req-12f9d0cf-81d4-46e3-97ab-9c8ba6c4c60f service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Detach interface failed, port_id=088ea6c2-0c4a-4f91-8464-f9c56da8f397, reason: Instance 61543d0a-92b8-4276-8301-4620468f0189 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-0d87f308-453f-49bc-a168-0807e59dbdb2 req-c09d5f55-f89a-4adc-8e18-197302ea5cad service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received event network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0d87f308-453f-49bc-a168-0807e59dbdb2 req-c09d5f55-f89a-4adc-8e18-197302ea5cad service nova] Acquiring lock "61543d0a-92b8-4276-8301-4620468f0189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0d87f308-453f-49bc-a168-0807e59dbdb2 req-c09d5f55-f89a-4adc-8e18-197302ea5cad service nova] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0d87f308-453f-49bc-a168-0807e59dbdb2 req-c09d5f55-f89a-4adc-8e18-197302ea5cad service nova] Lock "61543d0a-92b8-4276-8301-4620468f0189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-0d87f308-453f-49bc-a168-0807e59dbdb2 req-c09d5f55-f89a-4adc-8e18-197302ea5cad service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] No waiting events found dispatching network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:01:51 user nova-compute[75020]: WARNING nova.compute.manager [req-0d87f308-453f-49bc-a168-0807e59dbdb2 req-c09d5f55-f89a-4adc-8e18-197302ea5cad service nova] [instance: 61543d0a-92b8-4276-8301-4620468f0189] Received unexpected event network-vif-plugged-088ea6c2-0c4a-4f91-8464-f9c56da8f397 for instance with vm_state deleted and task_state None.
Nov 30 11:01:51 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:51 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Deleted allocations for instance 61543d0a-92b8-4276-8301-4620468f0189
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-005216e7-161f-4955-a2a6-c489b066402b tempest-AttachVolumeTestJSON-1562861090 tempest-AttachVolumeTestJSON-1562861090-project-member] Lock "61543d0a-92b8-4276-8301-4620468f0189" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.021s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:01:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:01:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:01:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:01:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=24.921382904052734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:01:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:01:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Applying migration context for instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 as it has an incoming, in-progress migration 0027eed6-4b02-4221-b8b4-88e5e7f9343c. Migration status is finished {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 11:01:55 user nova-compute[75020]: INFO nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating resource usage from migration 0027eed6-4b02-4221-b8b4-88e5e7f9343c
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 875f4516-89d8-432e-aaee-840162613ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 492f3123-e679-4a6c-a134-6c7912054463 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e135a295-5025-4013-bb21-634a2837f0d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 08b79baf-8036-4ac4-856d-b7dbce524ec3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Migration 0027eed6-4b02-4221-b8b4-88e5e7f9343c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:01:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:01:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:01:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:01:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:01:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-e2491a30-6e64-4eb4-b09a-f9020af0d438 req-2ce3b2e5-02a6-4233-bb19-dcbbe20ab2a3 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received event network-changed-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-e2491a30-6e64-4eb4-b09a-f9020af0d438 req-2ce3b2e5-02a6-4233-bb19-dcbbe20ab2a3 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Refreshing instance network info cache due to event network-changed-bf1932cd-f17b-44b7-ac71-ac89f2031f0d. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e2491a30-6e64-4eb4-b09a-f9020af0d438 req-2ce3b2e5-02a6-4233-bb19-dcbbe20ab2a3 service nova] Acquiring lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e2491a30-6e64-4eb4-b09a-f9020af0d438 req-2ce3b2e5-02a6-4233-bb19-dcbbe20ab2a3 service nova] Acquired lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG nova.network.neutron [req-e2491a30-6e64-4eb4-b09a-f9020af0d438 req-2ce3b2e5-02a6-4233-bb19-dcbbe20ab2a3 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Refreshing network info cache for port bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:18 user nova-compute[75020]: INFO nova.compute.manager [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Terminating instance
Nov 30 11:02:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-e2491a30-6e64-4eb4-b09a-f9020af0d438 req-2ce3b2e5-02a6-4233-bb19-dcbbe20ab2a3 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updated VIF entry in instance network info cache for port bf1932cd-f17b-44b7-ac71-ac89f2031f0d. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-e2491a30-6e64-4eb4-b09a-f9020af0d438 req-2ce3b2e5-02a6-4233-bb19-dcbbe20ab2a3 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updating instance_info_cache with network_info: [{"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e2491a30-6e64-4eb4-b09a-f9020af0d438 req-2ce3b2e5-02a6-4233-bb19-dcbbe20ab2a3 service nova] Releasing lock "refresh_cache-e135a295-5025-4013-bb21-634a2837f0d8" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:02:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Instance destroyed successfully.
Nov 30 11:02:19 user nova-compute[75020]: DEBUG nova.objects.instance [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'resources' on Instance uuid e135a295-5025-4013-bb21-634a2837f0d8 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-932943961',display_name='tempest-TestStampPattern-server-932943961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-932943961',id=28,image_ref='6e2901b4-d244-4b41-a4d7-ebf1bbab999b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8UuvcChSK6YskalIYpxvBcattqsFAEkXGidi6+8eqZCgj0JoQFKkJY54GUIo9V7Y2I7TNjEyC4R61MG4WaGSwKn4DJq095MqcrSgDLeoxMdOBD3ZIwKqXIZYjQCzQP2A==',key_name='tempest-TestStampPattern-1231142888',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d999c2680894b4da64f0225c6bcdd21',ramdisk_id='',reservation_id='r-mum0ofv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='875f4516-89d8-432e-aaee-840162613ba1',image_min_disk='1',image_min_ram='0',image_owner_id='0d999c2680894b4da64f0225c6bcdd21',image_owner_project_name='tempest-TestStampPattern-978441576',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-978441576-project-member',image_user_id='4f7cebdc6c934eaa97be8559abb908c3',owner_project_name='tempest-TestStampPattern-978441576',owner_user_name='tempest-TestStampPattern-978441576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:59:27Z,user_data=None,user_id='4f7cebdc6c934eaa97be8559abb908c3',uuid=e135a295-5025-4013-bb21-634a2837f0d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converting VIF {"id": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "address": "fa:16:3e:f1:b0:c5", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1932cd-f1", "ovs_interfaceid": "bf1932cd-f17b-44b7-ac71-ac89f2031f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=bf1932cd-f17b-44b7-ac71-ac89f2031f0d,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1932cd-f1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG os_vif [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=bf1932cd-f17b-44b7-ac71-ac89f2031f0d,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1932cd-f1') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf1932cd-f1, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=253dbd4e-4475-40e2-ab3d-38a546500262) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:19 user nova-compute[75020]: INFO os_vif [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b0:c5,bridge_name='br-int',has_traffic_filtering=True,id=bf1932cd-f17b-44b7-ac71-ac89f2031f0d,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1932cd-f1')
Nov 30 11:02:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Deleting instance files /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8_del
Nov 30 11:02:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Deletion of /opt/stack/data/nova/instances/e135a295-5025-4013-bb21-634a2837f0d8_del complete
Nov 30 11:02:19 user nova-compute[75020]: INFO nova.compute.manager [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 30 11:02:19 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:02:19 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: e135a295-5025-4013-bb21-634a2837f0d8] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:20 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Took 0.45 seconds to deallocate network for instance.
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-44af2c70-9233-4627-8131-caf7877b6773 req-a0e8326b-a89a-43d2-9c3b-1c17a76d0300 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received event network-vif-deleted-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:20 user nova-compute[75020]: INFO nova.compute.manager [req-44af2c70-9233-4627-8131-caf7877b6773 req-a0e8326b-a89a-43d2-9c3b-1c17a76d0300 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Neutron deleted interface bf1932cd-f17b-44b7-ac71-ac89f2031f0d; detaching it from the instance and deleting it from the info cache
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-44af2c70-9233-4627-8131-caf7877b6773 req-a0e8326b-a89a-43d2-9c3b-1c17a76d0300 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-44af2c70-9233-4627-8131-caf7877b6773 req-a0e8326b-a89a-43d2-9c3b-1c17a76d0300 service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Detach interface failed, port_id=bf1932cd-f17b-44b7-ac71-ac89f2031f0d, reason: Instance e135a295-5025-4013-bb21-634a2837f0d8 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received event network-vif-unplugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] No waiting events found dispatching network-vif-unplugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:02:20 user nova-compute[75020]: WARNING nova.compute.manager [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received unexpected event network-vif-unplugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d for instance with vm_state deleted and task_state None.
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received event network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] Acquiring lock "e135a295-5025-4013-bb21-634a2837f0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] Lock "e135a295-5025-4013-bb21-634a2837f0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] No waiting events found dispatching network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:02:20 user nova-compute[75020]: WARNING nova.compute.manager [req-c4bee9d7-a2a6-48c5-adf7-3f8e011096ff req-ac0dc696-b14b-4edb-aa7d-0b689ea637cd service nova] [instance: e135a295-5025-4013-bb21-634a2837f0d8] Received unexpected event network-vif-plugged-bf1932cd-f17b-44b7-ac71-ac89f2031f0d for instance with vm_state deleted and task_state None.
Nov 30 11:02:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:02:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:20 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Deleted allocations for instance e135a295-5025-4013-bb21-634a2837f0d8
Nov 30 11:02:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-55228228-93a1-4a00-b8e4-61c648d9faf1 tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "e135a295-5025-4013-bb21-634a2837f0d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.166s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:02:29 user nova-compute[75020]: INFO nova.compute.claims [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Claim successful on node user
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:02:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.policy [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21509ab3a62442a2acb7593f0cb7b7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801bc1fb7aae4784a7a42b091b2abb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:02:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Creating image(s)
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "/opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "/opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "/opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk 1073741824" returned: 0 in 0.100s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Successfully created port: ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Cannot resize image /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Ensure instance console log exists: /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Successfully updated port: ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "refresh_cache-35af8fb2-5ff1-4570-b0fb-042a49428b8b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquired lock "refresh_cache-35af8fb2-5ff1-4570-b0fb-042a49428b8b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-f176ae83-56c0-4c54-b79b-802baabf748c req-21214e2c-dc98-48bb-8c7f-64422351a6e2 service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received event network-changed-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-f176ae83-56c0-4c54-b79b-802baabf748c req-21214e2c-dc98-48bb-8c7f-64422351a6e2 service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Refreshing instance network info cache due to event network-changed-ba4a921b-6834-4029-b659-dacd830a14d5. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f176ae83-56c0-4c54-b79b-802baabf748c req-21214e2c-dc98-48bb-8c7f-64422351a6e2 service nova] Acquiring lock "refresh_cache-35af8fb2-5ff1-4570-b0fb-042a49428b8b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Updating instance_info_cache with network_info: [{"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Releasing lock "refresh_cache-35af8fb2-5ff1-4570-b0fb-042a49428b8b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Instance network_info: |[{"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f176ae83-56c0-4c54-b79b-802baabf748c req-21214e2c-dc98-48bb-8c7f-64422351a6e2 service nova] Acquired lock "refresh_cache-35af8fb2-5ff1-4570-b0fb-042a49428b8b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-f176ae83-56c0-4c54-b79b-802baabf748c req-21214e2c-dc98-48bb-8c7f-64422351a6e2 service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Refreshing network info cache for port ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Start _get_guest_xml network_info=[{"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:02:31 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:02:31 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2136257987',display_name='tempest-VolumesActionsTest-instance-2136257987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2136257987',id=31,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='801bc1fb7aae4784a7a42b091b2abb36',ramdisk_id='',reservation_id='r-fiyiy1ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1020938486',owner_user_name='tempest-VolumesActionsTest-1020938486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:02:30Z,user_data=None,user_id='21509ab3a62442a2acb7593f0cb7b7f8',uuid=35af8fb2-5ff1-4570-b0fb-042a49428b8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Converting VIF {"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:aa:97,bridge_name='br-int',has_traffic_filtering=True,id=ba4a921b-6834-4029-b659-dacd830a14d5,network=Network(45373c66-7fec-4fb4-b9a2-779640ddb41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4a921b-68') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lazy-loading 'pci_devices' on Instance uuid 35af8fb2-5ff1-4570-b0fb-042a49428b8b {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:02:31 user nova-compute[75020]:   <uuid>35af8fb2-5ff1-4570-b0fb-042a49428b8b</uuid>
Nov 30 11:02:31 user nova-compute[75020]:   <name>instance-0000001f</name>
Nov 30 11:02:31 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:02:31 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:02:31 user nova-compute[75020]:   <metadata>
Nov 30 11:02:31 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:02:31 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:02:31 user nova-compute[75020]:       <nova:name>tempest-VolumesActionsTest-instance-2136257987</nova:name>
Nov 30 11:02:31 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:02:31</nova:creationTime>
Nov 30 11:02:31 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:02:31 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:02:31 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:02:31 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:02:31 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:02:31 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:02:31 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:02:31 user nova-compute[75020]:       <nova:owner>
Nov 30 11:02:31 user nova-compute[75020]:         <nova:user uuid="21509ab3a62442a2acb7593f0cb7b7f8">tempest-VolumesActionsTest-1020938486-project-member</nova:user>
Nov 30 11:02:31 user nova-compute[75020]:         <nova:project uuid="801bc1fb7aae4784a7a42b091b2abb36">tempest-VolumesActionsTest-1020938486</nova:project>
Nov 30 11:02:31 user nova-compute[75020]:       </nova:owner>
Nov 30 11:02:31 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:02:31 user nova-compute[75020]:       <nova:ports>
Nov 30 11:02:31 user nova-compute[75020]:         <nova:port uuid="ba4a921b-6834-4029-b659-dacd830a14d5">
Nov 30 11:02:31 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 11:02:31 user nova-compute[75020]:         </nova:port>
Nov 30 11:02:31 user nova-compute[75020]:       </nova:ports>
Nov 30 11:02:31 user nova-compute[75020]:     </nova:instance>
Nov 30 11:02:31 user nova-compute[75020]:   </metadata>
Nov 30 11:02:31 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:02:31 user nova-compute[75020]:     <system>
Nov 30 11:02:31 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:02:31 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:02:31 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:02:31 user nova-compute[75020]:       <entry name="serial">35af8fb2-5ff1-4570-b0fb-042a49428b8b</entry>
Nov 30 11:02:31 user nova-compute[75020]:       <entry name="uuid">35af8fb2-5ff1-4570-b0fb-042a49428b8b</entry>
Nov 30 11:02:31 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:02:31 user nova-compute[75020]:     </system>
Nov 30 11:02:31 user nova-compute[75020]:   </sysinfo>
Nov 30 11:02:31 user nova-compute[75020]:   <os>
Nov 30 11:02:31 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:02:31 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:02:31 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:02:31 user nova-compute[75020]:   </os>
Nov 30 11:02:31 user nova-compute[75020]:   <features>
Nov 30 11:02:31 user nova-compute[75020]:     <acpi/>
Nov 30 11:02:31 user nova-compute[75020]:     <apic/>
Nov 30 11:02:31 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:02:31 user nova-compute[75020]:   </features>
Nov 30 11:02:31 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:02:31 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:02:31 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:02:31 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:02:31 user nova-compute[75020]:   </clock>
Nov 30 11:02:31 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:02:31 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:02:31 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:02:31 user nova-compute[75020]:   </cpu>
Nov 30 11:02:31 user nova-compute[75020]:   <devices>
Nov 30 11:02:31 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:02:31 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:02:31 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk"/>
Nov 30 11:02:31 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:02:31 user nova-compute[75020]:     </disk>
Nov 30 11:02:31 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:02:31 user nova-compute[75020]:       <mac address="fa:16:3e:05:aa:97"/>
Nov 30 11:02:31 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:02:31 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:02:31 user nova-compute[75020]:       <target dev="tapba4a921b-68"/>
Nov 30 11:02:31 user nova-compute[75020]:     </interface>
Nov 30 11:02:31 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:02:31 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/console.log" append="off"/>
Nov 30 11:02:31 user nova-compute[75020]:     </serial>
Nov 30 11:02:31 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:02:31 user nova-compute[75020]:     <video>
Nov 30 11:02:31 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:02:31 user nova-compute[75020]:     </video>
Nov 30 11:02:31 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:02:31 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:02:31 user nova-compute[75020]:     </rng>
Nov 30 11:02:31 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:02:31 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:02:31 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:02:31 user nova-compute[75020]:     </memballoon>
Nov 30 11:02:31 user nova-compute[75020]:   </devices>
Nov 30 11:02:31 user nova-compute[75020]: </domain>
Nov 30 11:02:31 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2136257987',display_name='tempest-VolumesActionsTest-instance-2136257987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2136257987',id=31,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='801bc1fb7aae4784a7a42b091b2abb36',ramdisk_id='',reservation_id='r-fiyiy1ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1020938486',owner_user_name='tempest-VolumesActionsTest-1020938486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:02:30Z,user_data=None,user_id='21509ab3a62442a2acb7593f0cb7b7f8',uuid=35af8fb2-5ff1-4570-b0fb-042a49428b8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Converting VIF {"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:aa:97,bridge_name='br-int',has_traffic_filtering=True,id=ba4a921b-6834-4029-b659-dacd830a14d5,network=Network(45373c66-7fec-4fb4-b9a2-779640ddb41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4a921b-68') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG os_vif [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:aa:97,bridge_name='br-int',has_traffic_filtering=True,id=ba4a921b-6834-4029-b659-dacd830a14d5,network=Network(45373c66-7fec-4fb4-b9a2-779640ddb41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4a921b-68') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b06208d-b748-5286-96a7-06c540dbf2ed', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4a921b-68, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba4a921b-68, col_values=(('qos', UUID('7fdc338f-b70b-42fd-920f-6217da85a403')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba4a921b-68, col_values=(('external_ids', {'iface-id': 'ba4a921b-6834-4029-b659-dacd830a14d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:aa:97', 'vm-uuid': '35af8fb2-5ff1-4570-b0fb-042a49428b8b'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:31 user nova-compute[75020]: INFO os_vif [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:aa:97,bridge_name='br-int',has_traffic_filtering=True,id=ba4a921b-6834-4029-b659-dacd830a14d5,network=Network(45373c66-7fec-4fb4-b9a2-779640ddb41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4a921b-68')
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:02:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] No VIF found with MAC fa:16:3e:05:aa:97, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:02:32 user nova-compute[75020]: DEBUG nova.network.neutron [req-f176ae83-56c0-4c54-b79b-802baabf748c req-21214e2c-dc98-48bb-8c7f-64422351a6e2 service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Updated VIF entry in instance network info cache for port ba4a921b-6834-4029-b659-dacd830a14d5. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:02:32 user nova-compute[75020]: DEBUG nova.network.neutron [req-f176ae83-56c0-4c54-b79b-802baabf748c req-21214e2c-dc98-48bb-8c7f-64422351a6e2 service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Updating instance_info_cache with network_info: [{"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f176ae83-56c0-4c54-b79b-802baabf748c req-21214e2c-dc98-48bb-8c7f-64422351a6e2 service nova] Releasing lock "refresh_cache-35af8fb2-5ff1-4570-b0fb-042a49428b8b" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-0b7fc22e-a32d-403e-9c69-d281e55afe01 req-19cf3401-799f-4bd7-b994-78e0a1fff4fa service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received event network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0b7fc22e-a32d-403e-9c69-d281e55afe01 req-19cf3401-799f-4bd7-b994-78e0a1fff4fa service nova] Acquiring lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0b7fc22e-a32d-403e-9c69-d281e55afe01 req-19cf3401-799f-4bd7-b994-78e0a1fff4fa service nova] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0b7fc22e-a32d-403e-9c69-d281e55afe01 req-19cf3401-799f-4bd7-b994-78e0a1fff4fa service nova] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-0b7fc22e-a32d-403e-9c69-d281e55afe01 req-19cf3401-799f-4bd7-b994-78e0a1fff4fa service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] No waiting events found dispatching network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:02:33 user nova-compute[75020]: WARNING nova.compute.manager [req-0b7fc22e-a32d-403e-9c69-d281e55afe01 req-19cf3401-799f-4bd7-b994-78e0a1fff4fa service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received unexpected event network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 for instance with vm_state building and task_state spawning.
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:02:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Instance spawned successfully.
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:02:35 user nova-compute[75020]: INFO nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:02:35 user nova-compute[75020]: INFO nova.compute.manager [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Took 6.40 seconds to build instance.
Nov 30 11:02:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d86e470a-0740-4214-aeef-330c2f35c002 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.621s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-b918fd65-3c42-4272-9632-879dc9df4845 req-599b0973-c9f8-4032-a120-395309c47d5c service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received event network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b918fd65-3c42-4272-9632-879dc9df4845 req-599b0973-c9f8-4032-a120-395309c47d5c service nova] Acquiring lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b918fd65-3c42-4272-9632-879dc9df4845 req-599b0973-c9f8-4032-a120-395309c47d5c service nova] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b918fd65-3c42-4272-9632-879dc9df4845 req-599b0973-c9f8-4032-a120-395309c47d5c service nova] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-b918fd65-3c42-4272-9632-879dc9df4845 req-599b0973-c9f8-4032-a120-395309c47d5c service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] No waiting events found dispatching network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:02:35 user nova-compute[75020]: WARNING nova.compute.manager [req-b918fd65-3c42-4272-9632-879dc9df4845 req-599b0973-c9f8-4032-a120-395309c47d5c service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received unexpected event network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 for instance with vm_state active and task_state None.
Nov 30 11:02:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-dc12d9e8-663f-4708-b621-6077e6631332 req-7477a934-d556-4b07-9fd5-f4635726129e service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received event network-changed-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-dc12d9e8-663f-4708-b621-6077e6631332 req-7477a934-d556-4b07-9fd5-f4635726129e service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Refreshing instance network info cache due to event network-changed-e0021916-7934-4154-b33c-b4c100e51448. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc12d9e8-663f-4708-b621-6077e6631332 req-7477a934-d556-4b07-9fd5-f4635726129e service nova] Acquiring lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc12d9e8-663f-4708-b621-6077e6631332 req-7477a934-d556-4b07-9fd5-f4635726129e service nova] Acquired lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-dc12d9e8-663f-4708-b621-6077e6631332 req-7477a934-d556-4b07-9fd5-f4635726129e service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Refreshing network info cache for port e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-dc12d9e8-663f-4708-b621-6077e6631332 req-7477a934-d556-4b07-9fd5-f4635726129e service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Updated VIF entry in instance network info cache for port e0021916-7934-4154-b33c-b4c100e51448. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-dc12d9e8-663f-4708-b621-6077e6631332 req-7477a934-d556-4b07-9fd5-f4635726129e service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Updating instance_info_cache with network_info: [{"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc12d9e8-663f-4708-b621-6077e6631332 req-7477a934-d556-4b07-9fd5-f4635726129e service nova] Releasing lock "refresh_cache-08b79baf-8036-4ac4-856d-b7dbce524ec3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:02:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:02:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:46 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:02:46 user nova-compute[75020]: INFO nova.compute.claims [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Claim successful on node user
Nov 30 11:02:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:47 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:02:47 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:02:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:02:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:02:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:02:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:02:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:02:47 user nova-compute[75020]: INFO nova.virt.block_device [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Booting with volume snapshot f7511201-dced-44f4-9caa-7df4698af292 at /dev/vda
Nov 30 11:02:47 user nova-compute[75020]: DEBUG nova.policy [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19afae8899f440c78b8a442361d5b531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c52e77c7064c97bc18c9df58ae20ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:02:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Successfully created port: 225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:02:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Successfully updated port: 225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:02:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:02:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquired lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:02:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-3247a61b-421d-4da9-b410-69866df8af2e req-f276d7d4-a185-4f90-932b-b1c4754df841 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received event network-changed-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-3247a61b-421d-4da9-b410-69866df8af2e req-f276d7d4-a185-4f90-932b-b1c4754df841 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Refreshing instance network info cache due to event network-changed-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3247a61b-421d-4da9-b410-69866df8af2e req-f276d7d4-a185-4f90-932b-b1c4754df841 service nova] Acquiring lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Updating instance_info_cache with network_info: [{"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Releasing lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Instance network_info: |[{"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3247a61b-421d-4da9-b410-69866df8af2e req-f276d7d4-a185-4f90-932b-b1c4754df841 service nova] Acquired lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:02:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-3247a61b-421d-4da9-b410-69866df8af2e req-f276d7d4-a185-4f90-932b-b1c4754df841 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Refreshing network info cache for port 225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating instance_info_cache with network_info: [{"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-9768f14b-9e34-421e-be7c-e541442814e4" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-3247a61b-421d-4da9-b410-69866df8af2e req-f276d7d4-a185-4f90-932b-b1c4754df841 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Updated VIF entry in instance network info cache for port 225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-3247a61b-421d-4da9-b410-69866df8af2e req-f276d7d4-a185-4f90-932b-b1c4754df841 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Updating instance_info_cache with network_info: [{"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3247a61b-421d-4da9-b410-69866df8af2e req-f276d7d4-a185-4f90-932b-b1c4754df841 service nova] Releasing lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG os_brick.utils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d42777-84c7-4911-8990-54f9cd607261]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21ede29-812b-4286-ba11-add338e0df54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226f0cb-c28a-4786-955d-3456e8924f2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5751a5b4-b6e2-408e-852c-bc363af47a28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:02:53 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb510c52-cf0e-4b9a-92c1-3c8ea3fa51bd]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG os_brick.utils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Updating existing volume attachment record: b8d65012-289d-4efe-b9df-d292c25b6290 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:02:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:02:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7528MB free_disk=24.88100814819336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Applying migration context for instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 as it has an incoming, in-progress migration 0027eed6-4b02-4221-b8b4-88e5e7f9343c. Migration status is finished {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 11:02:54 user nova-compute[75020]: INFO nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating resource usage from migration 0027eed6-4b02-4221-b8b4-88e5e7f9343c
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 875f4516-89d8-432e-aaee-840162613ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 492f3123-e679-4a6c-a134-6c7912054463 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 08b79baf-8036-4ac4-856d-b7dbce524ec3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Migration 0027eed6-4b02-4221-b8b4-88e5e7f9343c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 35af8fb2-5ff1-4570-b0fb-042a49428b8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance ccf0a65b-e4a1-4606-aa36-eda1f07c2e14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:02:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:02:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:02:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:02:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:02:59 user nova-compute[75020]: INFO nova.compute.manager [None req-2b32cef9-7244-4c0f-a46d-4386b2024487 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Unrescuing
Nov 30 11:02:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2b32cef9-7244-4c0f-a46d-4386b2024487 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:02:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2b32cef9-7244-4c0f-a46d-4386b2024487 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquired lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:02:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2b32cef9-7244-4c0f-a46d-4386b2024487 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2b32cef9-7244-4c0f-a46d-4386b2024487 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Updating instance_info_cache with network_info: [{"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2b32cef9-7244-4c0f-a46d-4386b2024487 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Releasing lock "refresh_cache-492f3123-e679-4a6c-a134-6c7912054463" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2b32cef9-7244-4c0f-a46d-4386b2024487 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'flavor' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-c715ca2d-e074-4bcd-8f41-d8fc92489df5 req-589c66a2-7d0a-454a-8191-14cb82d293bc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c715ca2d-e074-4bcd-8f41-d8fc92489df5 req-589c66a2-7d0a-454a-8191-14cb82d293bc service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c715ca2d-e074-4bcd-8f41-d8fc92489df5 req-589c66a2-7d0a-454a-8191-14cb82d293bc service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c715ca2d-e074-4bcd-8f41-d8fc92489df5 req-589c66a2-7d0a-454a-8191-14cb82d293bc service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-c715ca2d-e074-4bcd-8f41-d8fc92489df5 req-589c66a2-7d0a-454a-8191-14cb82d293bc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:00 user nova-compute[75020]: WARNING nova.compute.manager [req-c715ca2d-e074-4bcd-8f41-d8fc92489df5 req-589c66a2-7d0a-454a-8191-14cb82d293bc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:03:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance destroyed successfully.
Nov 30 11:03:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-6418db86-f053-4ca4-a5ae-b7987b8b638a req-004a5bfb-f945-413c-9a08-e3d3ac8ff28f service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6418db86-f053-4ca4-a5ae-b7987b8b638a req-004a5bfb-f945-413c-9a08-e3d3ac8ff28f service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6418db86-f053-4ca4-a5ae-b7987b8b638a req-004a5bfb-f945-413c-9a08-e3d3ac8ff28f service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6418db86-f053-4ca4-a5ae-b7987b8b638a req-004a5bfb-f945-413c-9a08-e3d3ac8ff28f service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-6418db86-f053-4ca4-a5ae-b7987b8b638a req-004a5bfb-f945-413c-9a08-e3d3ac8ff28f service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:02 user nova-compute[75020]: WARNING nova.compute.manager [req-6418db86-f053-4ca4-a5ae-b7987b8b638a req-004a5bfb-f945-413c-9a08-e3d3ac8ff28f service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:03:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:04 user nova-compute[75020]: WARNING nova.compute.manager [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:03:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:04 user nova-compute[75020]: WARNING nova.compute.manager [req-d69efd6c-e5b5-4236-b8e9-1c6699f9a833 req-3ce31720-8818-4925-831f-85318ad052dc service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:03:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2b32cef9-7244-4c0f-a46d-4386b2024487 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:03:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Going to confirm migration 1 {{(pid=75020) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquired lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'info_cache' on Instance uuid 79fe1d49-08c7-4197-a6b6-7f7dc4500487 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating instance_info_cache with network_info: [{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Releasing lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'migration_context' on Instance uuid 79fe1d49-08c7-4197-a6b6-7f7dc4500487 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG nova.objects.base [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Object Instance<79fe1d49-08c7-4197-a6b6-7f7dc4500487> lazy-loaded attributes: info_cache,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.581s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:10 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Deleted allocation for migration 0027eed6-4b02-4221-b8b4-88e5e7f9343c
Nov 30 11:03:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fbd86d06-34f8-4a65-a3c5-709d5051231f tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.585s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:03:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Creating image(s)
Nov 30 11:03:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Ensure instance console log exists: /opt/stack/data/nova/instances/ccf0a65b-e4a1-4606-aa36-eda1f07c2e14/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Start _get_guest_xml network_info=[{"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T11:02:40Z,direct_url=<?>,disk_format='qcow2',id=4d964f34-dc8a-49c3-bfe0-9758ec581374,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-647732132',owner='54c52e77c7064c97bc18c9df58ae20ef',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T11:02:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'b8d65012-289d-4efe-b9df-d292c25b6290', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRredyit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ccf0a65b-e4a1-4606-aa36-eda1f07c2e14', 'attached_at': '', 'detached_at': '', 'volume_id': '92f4a094-3d74-46dc-9373-62d3127c3059', 'serial': '92f4a094-3d74-46dc-9373-62d3127c3059'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:03:11 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:03:11 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T11:02:40Z,direct_url=<?>,disk_format='qcow2',id=4d964f34-dc8a-49c3-bfe0-9758ec581374,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-647732132',owner='54c52e77c7064c97bc18c9df58ae20ef',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T11:02:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRredyit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:03:11 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:03:11 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:03:11 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8429c2-3d80-44ca-bb01-6c28460923d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:03:11 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba40eca6-4507-4377-be12-52de2c3978bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059] added
Nov 30 11:03:11 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2a0cc1-f937-41cd-86c9-8b6ec3ce6fa3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae64762-dc05-4916-9132-a1f52537cdfe]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRredyit {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRredyit" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eddfec6-5427-477b-b37c-9c120abbe312]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QRredyit'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c79e8ad-6a05-4fb5-8338-552b361df814]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af52f5-0f3c-458e-9eba-04ac3c6c8e8c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:03:11 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:03:11 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[32155f38-60a6-4a2b-bebf-77cbfa930dd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059, portal: 172.16.0.220,3260]
Nov 30 11:03:11 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059, portal: 172.16.0.220,3260] successful.
Nov 30 11:03:11 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63193e2-c200-4228-8fb8-675c5d730a98]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cfb90d-f6c1-43a8-a57e-e4e3b3df5b87]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:03:11 user nova-compute[75020]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 (non-flash)
Nov 30 11:03:11 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[958690e0-7cf2-407a-957c-0ac9754cfe0b]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:03:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRredyit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23232323335356233', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232323335356233', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-706934598',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-706934598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-706934598',id=32,image_ref='4d964f34-dc8a-49c3-bfe0-9758ec581374',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDGeEYWyZDt7xIk2t5WpnSfLLA2YO/910Kf0Ys7mNnMHFmCGaFCFp7JeN8H29IkOxW/6KlLY0UD7KFQ3Ia6Hy1CMAmCK4xNH1a5kWVplvorFO+2b4AyPIdR4Z96ZVptLA==',key_name='tempest-keypair-1553440530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-hil5isry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1120216767',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19afae8899f440c78b8a442361d5b531',uuid=ccf0a65b-e4a1-4606-aa36-eda1f07c2e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225b4e7a-78') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.objects.instance [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'pci_devices' on Instance uuid ccf0a65b-e4a1-4606-aa36-eda1f07c2e14 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:03:12 user nova-compute[75020]:   <uuid>ccf0a65b-e4a1-4606-aa36-eda1f07c2e14</uuid>
Nov 30 11:03:12 user nova-compute[75020]:   <name>instance-00000020</name>
Nov 30 11:03:12 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:03:12 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:03:12 user nova-compute[75020]:   <metadata>
Nov 30 11:03:12 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:03:12 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:03:12 user nova-compute[75020]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-706934598</nova:name>
Nov 30 11:03:12 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:03:11</nova:creationTime>
Nov 30 11:03:12 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:03:12 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:03:12 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:03:12 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:03:12 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:03:12 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:03:12 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:03:12 user nova-compute[75020]:       <nova:owner>
Nov 30 11:03:12 user nova-compute[75020]:         <nova:user uuid="19afae8899f440c78b8a442361d5b531">tempest-TestVolumeBootPattern-1120216767-project-member</nova:user>
Nov 30 11:03:12 user nova-compute[75020]:         <nova:project uuid="54c52e77c7064c97bc18c9df58ae20ef">tempest-TestVolumeBootPattern-1120216767</nova:project>
Nov 30 11:03:12 user nova-compute[75020]:       </nova:owner>
Nov 30 11:03:12 user nova-compute[75020]:       <nova:root type="image" uuid="4d964f34-dc8a-49c3-bfe0-9758ec581374"/>
Nov 30 11:03:12 user nova-compute[75020]:       <nova:ports>
Nov 30 11:03:12 user nova-compute[75020]:         <nova:port uuid="225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4">
Nov 30 11:03:12 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 11:03:12 user nova-compute[75020]:         </nova:port>
Nov 30 11:03:12 user nova-compute[75020]:       </nova:ports>
Nov 30 11:03:12 user nova-compute[75020]:     </nova:instance>
Nov 30 11:03:12 user nova-compute[75020]:   </metadata>
Nov 30 11:03:12 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:03:12 user nova-compute[75020]:     <system>
Nov 30 11:03:12 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:03:12 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:03:12 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:03:12 user nova-compute[75020]:       <entry name="serial">ccf0a65b-e4a1-4606-aa36-eda1f07c2e14</entry>
Nov 30 11:03:12 user nova-compute[75020]:       <entry name="uuid">ccf0a65b-e4a1-4606-aa36-eda1f07c2e14</entry>
Nov 30 11:03:12 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:03:12 user nova-compute[75020]:     </system>
Nov 30 11:03:12 user nova-compute[75020]:   </sysinfo>
Nov 30 11:03:12 user nova-compute[75020]:   <os>
Nov 30 11:03:12 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:03:12 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:03:12 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:03:12 user nova-compute[75020]:   </os>
Nov 30 11:03:12 user nova-compute[75020]:   <features>
Nov 30 11:03:12 user nova-compute[75020]:     <acpi/>
Nov 30 11:03:12 user nova-compute[75020]:     <apic/>
Nov 30 11:03:12 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:03:12 user nova-compute[75020]:   </features>
Nov 30 11:03:12 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:03:12 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:03:12 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:03:12 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:03:12 user nova-compute[75020]:   </clock>
Nov 30 11:03:12 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:03:12 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:03:12 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:03:12 user nova-compute[75020]:   </cpu>
Nov 30 11:03:12 user nova-compute[75020]:   <devices>
Nov 30 11:03:12 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:03:12 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:03:12 user nova-compute[75020]:       <source dev="/dev/sdc"/>
Nov 30 11:03:12 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:03:12 user nova-compute[75020]:       <serial>92f4a094-3d74-46dc-9373-62d3127c3059</serial>
Nov 30 11:03:12 user nova-compute[75020]:     </disk>
Nov 30 11:03:12 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:03:12 user nova-compute[75020]:       <mac address="fa:16:3e:ab:c3:78"/>
Nov 30 11:03:12 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:03:12 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:03:12 user nova-compute[75020]:       <target dev="tap225b4e7a-78"/>
Nov 30 11:03:12 user nova-compute[75020]:     </interface>
Nov 30 11:03:12 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:03:12 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/ccf0a65b-e4a1-4606-aa36-eda1f07c2e14/console.log" append="off"/>
Nov 30 11:03:12 user nova-compute[75020]:     </serial>
Nov 30 11:03:12 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:03:12 user nova-compute[75020]:     <video>
Nov 30 11:03:12 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:03:12 user nova-compute[75020]:     </video>
Nov 30 11:03:12 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:03:12 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:03:12 user nova-compute[75020]:     </rng>
Nov 30 11:03:12 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:03:12 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:03:12 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:03:12 user nova-compute[75020]:     </memballoon>
Nov 30 11:03:12 user nova-compute[75020]:   </devices>
Nov 30 11:03:12 user nova-compute[75020]: </domain>
Nov 30 11:03:12 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-706934598',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-706934598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-706934598',id=32,image_ref='4d964f34-dc8a-49c3-bfe0-9758ec581374',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDGeEYWyZDt7xIk2t5WpnSfLLA2YO/910Kf0Ys7mNnMHFmCGaFCFp7JeN8H29IkOxW/6KlLY0UD7KFQ3Ia6Hy1CMAmCK4xNH1a5kWVplvorFO+2b4AyPIdR4Z96ZVptLA==',key_name='tempest-keypair-1553440530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-hil5isry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1120216767',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19afae8899f440c78b8a442361d5b531',uuid=ccf0a65b-e4a1-4606-aa36-eda1f07c2e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225b4e7a-78') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG os_vif [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225b4e7a-78') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9423cd5-120a-520b-a748-014115bc4e03', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap225b4e7a-78, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap225b4e7a-78, col_values=(('qos', UUID('fcf6fc05-073c-415f-a326-1e476a0bae10')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap225b4e7a-78, col_values=(('external_ids', {'iface-id': '225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:c3:78', 'vm-uuid': 'ccf0a65b-e4a1-4606-aa36-eda1f07c2e14'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:12 user nova-compute[75020]: INFO os_vif [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225b4e7a-78')
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:03:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No VIF found with MAC fa:16:3e:ab:c3:78, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:03:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-6952ff4a-fc70-4aae-a033-06dc5baea61f req-23669848-b183-4e0e-99e6-d22d311d0473 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received event network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6952ff4a-fc70-4aae-a033-06dc5baea61f req-23669848-b183-4e0e-99e6-d22d311d0473 service nova] Acquiring lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6952ff4a-fc70-4aae-a033-06dc5baea61f req-23669848-b183-4e0e-99e6-d22d311d0473 service nova] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6952ff4a-fc70-4aae-a033-06dc5baea61f req-23669848-b183-4e0e-99e6-d22d311d0473 service nova] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-6952ff4a-fc70-4aae-a033-06dc5baea61f req-23669848-b183-4e0e-99e6-d22d311d0473 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] No waiting events found dispatching network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:14 user nova-compute[75020]: WARNING nova.compute.manager [req-6952ff4a-fc70-4aae-a033-06dc5baea61f req-23669848-b183-4e0e-99e6-d22d311d0473 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received unexpected event network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 for instance with vm_state building and task_state spawning.
Nov 30 11:03:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:03:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Instance spawned successfully.
Nov 30 11:03:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-898e5e27-2ef1-48ca-80cb-c72d566f1ec7 req-a3c7998b-232f-4e2c-96ec-37422bf4da0c service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received event network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-898e5e27-2ef1-48ca-80cb-c72d566f1ec7 req-a3c7998b-232f-4e2c-96ec-37422bf4da0c service nova] Acquiring lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-898e5e27-2ef1-48ca-80cb-c72d566f1ec7 req-a3c7998b-232f-4e2c-96ec-37422bf4da0c service nova] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-898e5e27-2ef1-48ca-80cb-c72d566f1ec7 req-a3c7998b-232f-4e2c-96ec-37422bf4da0c service nova] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-898e5e27-2ef1-48ca-80cb-c72d566f1ec7 req-a3c7998b-232f-4e2c-96ec-37422bf4da0c service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] No waiting events found dispatching network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:16 user nova-compute[75020]: WARNING nova.compute.manager [req-898e5e27-2ef1-48ca-80cb-c72d566f1ec7 req-a3c7998b-232f-4e2c-96ec-37422bf4da0c service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received unexpected event network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 for instance with vm_state building and task_state spawning.
Nov 30 11:03:16 user nova-compute[75020]: INFO nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 30 11:03:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:03:16 user nova-compute[75020]: INFO nova.compute.manager [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Took 29.84 seconds to build instance.
Nov 30 11:03:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-640e57a8-cae2-4d0b-b271-472b47b2a1fd tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.967s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:20 user nova-compute[75020]: INFO nova.compute.manager [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Terminating instance
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-adaa5758-0e2b-4a4c-b99c-798e1a83f2db req-40b67701-56e3-4aed-b9bf-321b23a1fe1e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-changed-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-adaa5758-0e2b-4a4c-b99c-798e1a83f2db req-40b67701-56e3-4aed-b9bf-321b23a1fe1e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Refreshing instance network info cache due to event network-changed-267a3846-2deb-4b5f-9dd9-5475b91be177. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-adaa5758-0e2b-4a4c-b99c-798e1a83f2db req-40b67701-56e3-4aed-b9bf-321b23a1fe1e service nova] Acquiring lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-adaa5758-0e2b-4a4c-b99c-798e1a83f2db req-40b67701-56e3-4aed-b9bf-321b23a1fe1e service nova] Acquired lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-adaa5758-0e2b-4a4c-b99c-798e1a83f2db req-40b67701-56e3-4aed-b9bf-321b23a1fe1e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Refreshing network info cache for port 267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-04560f62-5e96-486c-b277-416f4af9e211 req-18986670-b9e1-4215-a2e7-82d1bca88ff8 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-vif-unplugged-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04560f62-5e96-486c-b277-416f4af9e211 req-18986670-b9e1-4215-a2e7-82d1bca88ff8 service nova] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04560f62-5e96-486c-b277-416f4af9e211 req-18986670-b9e1-4215-a2e7-82d1bca88ff8 service nova] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-04560f62-5e96-486c-b277-416f4af9e211 req-18986670-b9e1-4215-a2e7-82d1bca88ff8 service nova] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-04560f62-5e96-486c-b277-416f4af9e211 req-18986670-b9e1-4215-a2e7-82d1bca88ff8 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] No waiting events found dispatching network-vif-unplugged-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-04560f62-5e96-486c-b277-416f4af9e211 req-18986670-b9e1-4215-a2e7-82d1bca88ff8 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-vif-unplugged-267a3846-2deb-4b5f-9dd9-5475b91be177 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-adaa5758-0e2b-4a4c-b99c-798e1a83f2db req-40b67701-56e3-4aed-b9bf-321b23a1fe1e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updated VIF entry in instance network info cache for port 267a3846-2deb-4b5f-9dd9-5475b91be177. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG nova.network.neutron [req-adaa5758-0e2b-4a4c-b99c-798e1a83f2db req-40b67701-56e3-4aed-b9bf-321b23a1fe1e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updating instance_info_cache with network_info: [{"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:03:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-adaa5758-0e2b-4a4c-b99c-798e1a83f2db req-40b67701-56e3-4aed-b9bf-321b23a1fe1e service nova] Releasing lock "refresh_cache-875f4516-89d8-432e-aaee-840162613ba1" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:21 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Instance destroyed successfully.
Nov 30 11:03:21 user nova-compute[75020]: DEBUG nova.objects.instance [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lazy-loading 'resources' on Instance uuid 875f4516-89d8-432e-aaee-840162613ba1 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1702229472',display_name='tempest-TestStampPattern-server-1702229472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1702229472',id=23,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8UuvcChSK6YskalIYpxvBcattqsFAEkXGidi6+8eqZCgj0JoQFKkJY54GUIo9V7Y2I7TNjEyC4R61MG4WaGSwKn4DJq095MqcrSgDLeoxMdOBD3ZIwKqXIZYjQCzQP2A==',key_name='tempest-TestStampPattern-1231142888',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d999c2680894b4da64f0225c6bcdd21',ramdisk_id='',reservation_id='r-ww17nxyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-978441576',owner_user_name='tempest-TestStampPattern-978441576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:59:17Z,user_data=None,user_id='4f7cebdc6c934eaa97be8559abb908c3',uuid=875f4516-89d8-432e-aaee-840162613ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converting VIF {"id": "267a3846-2deb-4b5f-9dd9-5475b91be177", "address": "fa:16:3e:60:7d:40", "network": {"id": "27dd7c34-ccbe-45dc-858b-10fb8a878189", "bridge": "br-int", "label": "tempest-TestStampPattern-1062995016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d999c2680894b4da64f0225c6bcdd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267a3846-2d", "ovs_interfaceid": "267a3846-2deb-4b5f-9dd9-5475b91be177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=267a3846-2deb-4b5f-9dd9-5475b91be177,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267a3846-2d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG os_vif [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=267a3846-2deb-4b5f-9dd9-5475b91be177,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267a3846-2d') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap267a3846-2d, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e7a0820-e223-4b92-b0c3-ac22ffa0b226) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:03:21 user nova-compute[75020]: INFO os_vif [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7d:40,bridge_name='br-int',has_traffic_filtering=True,id=267a3846-2deb-4b5f-9dd9-5475b91be177,network=Network(27dd7c34-ccbe-45dc-858b-10fb8a878189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267a3846-2d')
Nov 30 11:03:21 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Deleting instance files /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1_del
Nov 30 11:03:21 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Deletion of /opt/stack/data/nova/instances/875f4516-89d8-432e-aaee-840162613ba1_del complete
Nov 30 11:03:21 user nova-compute[75020]: INFO nova.compute.manager [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 30 11:03:21 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 875f4516-89d8-432e-aaee-840162613ba1] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:03:21 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:03:21 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Took 0.67 seconds to deallocate network for instance.
Nov 30 11:03:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-ecd650be-5ee5-4806-8c09-d19c919b1bde req-585b343a-152c-40ef-b8ac-fb42bff0bf8e service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-vif-deleted-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:22 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Deleted allocations for instance 875f4516-89d8-432e-aaee-840162613ba1
Nov 30 11:03:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-574e58b6-d701-40e6-9e12-a2d790f2d39f tempest-TestStampPattern-978441576 tempest-TestStampPattern-978441576-project-member] Lock "875f4516-89d8-432e-aaee-840162613ba1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.414s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-f2ea7a87-3bf8-4f2a-ac2f-2022f45d0889 req-0dc663ca-98b2-4551-bc1a-df26192637b5 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received event network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f2ea7a87-3bf8-4f2a-ac2f-2022f45d0889 req-0dc663ca-98b2-4551-bc1a-df26192637b5 service nova] Acquiring lock "875f4516-89d8-432e-aaee-840162613ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f2ea7a87-3bf8-4f2a-ac2f-2022f45d0889 req-0dc663ca-98b2-4551-bc1a-df26192637b5 service nova] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f2ea7a87-3bf8-4f2a-ac2f-2022f45d0889 req-0dc663ca-98b2-4551-bc1a-df26192637b5 service nova] Lock "875f4516-89d8-432e-aaee-840162613ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-f2ea7a87-3bf8-4f2a-ac2f-2022f45d0889 req-0dc663ca-98b2-4551-bc1a-df26192637b5 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] No waiting events found dispatching network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:22 user nova-compute[75020]: WARNING nova.compute.manager [req-f2ea7a87-3bf8-4f2a-ac2f-2022f45d0889 req-0dc663ca-98b2-4551-bc1a-df26192637b5 service nova] [instance: 875f4516-89d8-432e-aaee-840162613ba1] Received unexpected event network-vif-plugged-267a3846-2deb-4b5f-9dd9-5475b91be177 for instance with vm_state deleted and task_state None.
Nov 30 11:03:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:03:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:34 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:03:34 user nova-compute[75020]: INFO nova.compute.claims [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Claim successful on node user
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:03:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.policy [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cee10a54cf845a6a328df4e9ea4be85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f16bf7c990e4b7c945642594b58584e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:03:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Creating image(s)
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk 1073741824" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:35 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Successfully created port: 903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Cannot resize image /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Ensure instance console log exists: /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Successfully updated port: 903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquired lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-27330535-cef3-4076-bd84-d061d05eaec0 req-e04f86fe-8288-485a-9342-6fca0026f3fa service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-changed-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-27330535-cef3-4076-bd84-d061d05eaec0 req-e04f86fe-8288-485a-9342-6fca0026f3fa service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Refreshing instance network info cache due to event network-changed-903ec885-1189-4bde-be19-0d7cabee638e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-27330535-cef3-4076-bd84-d061d05eaec0 req-e04f86fe-8288-485a-9342-6fca0026f3fa service nova] Acquiring lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:03:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Releasing lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance network_info: |[{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-27330535-cef3-4076-bd84-d061d05eaec0 req-e04f86fe-8288-485a-9342-6fca0026f3fa service nova] Acquired lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-27330535-cef3-4076-bd84-d061d05eaec0 req-e04f86fe-8288-485a-9342-6fca0026f3fa service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Refreshing network info cache for port 903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Start _get_guest_xml network_info=[{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:03:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:03:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2071756196',display_name='tempest-ServerRescueNegativeTestJSON-server-2071756196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2071756196',id=33,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuXk83Zzd7VusNvBjcbhIiGlQNKPBpumulr0zlrDK2/TWLgAPCvxATdCN65Fgva4S1jzF8fUTozTYSKQtaF6MDusWOL6TRQRk22LbSWdYxFuNqD7I4ecZDouVEay4u5kw==',key_name='tempest-keypair-251013875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-auym15az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:c2:c8,bridge_name='br-int',has_traffic_filtering=True,id=903ec885-1189-4bde-be19-0d7cabee638e,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903ec885-11') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'pci_devices' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:03:37 user nova-compute[75020]:   <uuid>d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466</uuid>
Nov 30 11:03:37 user nova-compute[75020]:   <name>instance-00000021</name>
Nov 30 11:03:37 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:03:37 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:03:37 user nova-compute[75020]:   <metadata>
Nov 30 11:03:37 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:03:37 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:03:37 user nova-compute[75020]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2071756196</nova:name>
Nov 30 11:03:37 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:03:37</nova:creationTime>
Nov 30 11:03:37 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:03:37 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:03:37 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:03:37 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:03:37 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:03:37 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:03:37 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:03:37 user nova-compute[75020]:       <nova:owner>
Nov 30 11:03:37 user nova-compute[75020]:         <nova:user uuid="2cee10a54cf845a6a328df4e9ea4be85">tempest-ServerRescueNegativeTestJSON-2071093195-project-member</nova:user>
Nov 30 11:03:37 user nova-compute[75020]:         <nova:project uuid="8f16bf7c990e4b7c945642594b58584e">tempest-ServerRescueNegativeTestJSON-2071093195</nova:project>
Nov 30 11:03:37 user nova-compute[75020]:       </nova:owner>
Nov 30 11:03:37 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:03:37 user nova-compute[75020]:       <nova:ports>
Nov 30 11:03:37 user nova-compute[75020]:         <nova:port uuid="903ec885-1189-4bde-be19-0d7cabee638e">
Nov 30 11:03:37 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 11:03:37 user nova-compute[75020]:         </nova:port>
Nov 30 11:03:37 user nova-compute[75020]:       </nova:ports>
Nov 30 11:03:37 user nova-compute[75020]:     </nova:instance>
Nov 30 11:03:37 user nova-compute[75020]:   </metadata>
Nov 30 11:03:37 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:03:37 user nova-compute[75020]:     <system>
Nov 30 11:03:37 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:03:37 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:03:37 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:03:37 user nova-compute[75020]:       <entry name="serial">d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466</entry>
Nov 30 11:03:37 user nova-compute[75020]:       <entry name="uuid">d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466</entry>
Nov 30 11:03:37 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:03:37 user nova-compute[75020]:     </system>
Nov 30 11:03:37 user nova-compute[75020]:   </sysinfo>
Nov 30 11:03:37 user nova-compute[75020]:   <os>
Nov 30 11:03:37 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:03:37 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:03:37 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:03:37 user nova-compute[75020]:   </os>
Nov 30 11:03:37 user nova-compute[75020]:   <features>
Nov 30 11:03:37 user nova-compute[75020]:     <acpi/>
Nov 30 11:03:37 user nova-compute[75020]:     <apic/>
Nov 30 11:03:37 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:03:37 user nova-compute[75020]:   </features>
Nov 30 11:03:37 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:03:37 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:03:37 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:03:37 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:03:37 user nova-compute[75020]:   </clock>
Nov 30 11:03:37 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:03:37 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:03:37 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:03:37 user nova-compute[75020]:   </cpu>
Nov 30 11:03:37 user nova-compute[75020]:   <devices>
Nov 30 11:03:37 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:03:37 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:03:37 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk"/>
Nov 30 11:03:37 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:03:37 user nova-compute[75020]:     </disk>
Nov 30 11:03:37 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:03:37 user nova-compute[75020]:       <mac address="fa:16:3e:34:c2:c8"/>
Nov 30 11:03:37 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:03:37 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:03:37 user nova-compute[75020]:       <target dev="tap903ec885-11"/>
Nov 30 11:03:37 user nova-compute[75020]:     </interface>
Nov 30 11:03:37 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:03:37 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/console.log" append="off"/>
Nov 30 11:03:37 user nova-compute[75020]:     </serial>
Nov 30 11:03:37 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:03:37 user nova-compute[75020]:     <video>
Nov 30 11:03:37 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:03:37 user nova-compute[75020]:     </video>
Nov 30 11:03:37 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:03:37 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:03:37 user nova-compute[75020]:     </rng>
Nov 30 11:03:37 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:03:37 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:03:37 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:03:37 user nova-compute[75020]:     </memballoon>
Nov 30 11:03:37 user nova-compute[75020]:   </devices>
Nov 30 11:03:37 user nova-compute[75020]: </domain>
Nov 30 11:03:37 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2071756196',display_name='tempest-ServerRescueNegativeTestJSON-server-2071756196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2071756196',id=33,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuXk83Zzd7VusNvBjcbhIiGlQNKPBpumulr0zlrDK2/TWLgAPCvxATdCN65Fgva4S1jzF8fUTozTYSKQtaF6MDusWOL6TRQRk22LbSWdYxFuNqD7I4ecZDouVEay4u5kw==',key_name='tempest-keypair-251013875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-auym15az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:c2:c8,bridge_name='br-int',has_traffic_filtering=True,id=903ec885-1189-4bde-be19-0d7cabee638e,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903ec885-11') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG os_vif [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:c2:c8,bridge_name='br-int',has_traffic_filtering=True,id=903ec885-1189-4bde-be19-0d7cabee638e,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903ec885-11') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '806cce5b-980d-5b3d-94ad-c7c852268e06', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903ec885-11, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap903ec885-11, col_values=(('qos', UUID('525df4c9-9196-439c-a30b-dbcd60d3c59a')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap903ec885-11, col_values=(('external_ids', {'iface-id': '903ec885-1189-4bde-be19-0d7cabee638e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:c2:c8', 'vm-uuid': 'd4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:37 user nova-compute[75020]: INFO os_vif [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:c2:c8,bridge_name='br-int',has_traffic_filtering=True,id=903ec885-1189-4bde-be19-0d7cabee638e,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903ec885-11')
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No VIF found with MAC fa:16:3e:34:c2:c8, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-27330535-cef3-4076-bd84-d061d05eaec0 req-e04f86fe-8288-485a-9342-6fca0026f3fa service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updated VIF entry in instance network info cache for port 903ec885-1189-4bde-be19-0d7cabee638e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-27330535-cef3-4076-bd84-d061d05eaec0 req-e04f86fe-8288-485a-9342-6fca0026f3fa service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:03:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-27330535-cef3-4076-bd84-d061d05eaec0 req-e04f86fe-8288-485a-9342-6fca0026f3fa service nova] Releasing lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-27666dc0-7885-4179-810a-96f3d054cca1 req-237d40c2-9d3b-4af1-861c-eddb80b5adb1 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-27666dc0-7885-4179-810a-96f3d054cca1 req-237d40c2-9d3b-4af1-861c-eddb80b5adb1 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-27666dc0-7885-4179-810a-96f3d054cca1 req-237d40c2-9d3b-4af1-861c-eddb80b5adb1 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-27666dc0-7885-4179-810a-96f3d054cca1 req-237d40c2-9d3b-4af1-861c-eddb80b5adb1 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-27666dc0-7885-4179-810a-96f3d054cca1 req-237d40c2-9d3b-4af1-861c-eddb80b5adb1 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:38 user nova-compute[75020]: WARNING nova.compute.manager [req-27666dc0-7885-4179-810a-96f3d054cca1 req-237d40c2-9d3b-4af1-861c-eddb80b5adb1 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state building and task_state spawning.
Nov 30 11:03:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-8ff47a31-9b88-405f-a2f4-2738075b8893 req-308b2325-cbba-4b3d-a4c6-a3b82410f52f service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8ff47a31-9b88-405f-a2f4-2738075b8893 req-308b2325-cbba-4b3d-a4c6-a3b82410f52f service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8ff47a31-9b88-405f-a2f4-2738075b8893 req-308b2325-cbba-4b3d-a4c6-a3b82410f52f service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8ff47a31-9b88-405f-a2f4-2738075b8893 req-308b2325-cbba-4b3d-a4c6-a3b82410f52f service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-8ff47a31-9b88-405f-a2f4-2738075b8893 req-308b2325-cbba-4b3d-a4c6-a3b82410f52f service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:03:40 user nova-compute[75020]: WARNING nova.compute.manager [req-8ff47a31-9b88-405f-a2f4-2738075b8893 req-308b2325-cbba-4b3d-a4c6-a3b82410f52f service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state building and task_state spawning.
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:03:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance spawned successfully.
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:03:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:03:41 user nova-compute[75020]: INFO nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 30 11:03:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:03:41 user nova-compute[75020]: INFO nova.compute.manager [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Took 6.61 seconds to build instance.
Nov 30 11:03:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fd96541d-b5f6-41c5-a44a-26084f6079e4 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.730s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:03:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:03:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:03:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:03:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updating instance_info_cache with network_info: [{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:03:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:03:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:03:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:03:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:03:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:03:55 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7380MB free_disk=24.99158477783203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:03:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:03:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 492f3123-e679-4a6c-a134-6c7912054463 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 08b79baf-8036-4ac4-856d-b7dbce524ec3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 35af8fb2-5ff1-4570-b0fb-042a49428b8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance ccf0a65b-e4a1-4606-aa36-eda1f07c2e14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:03:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.905s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:03:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:03:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:03:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:03:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:01 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:04:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:04:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:04:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "546f59fe-a233-4002-b737-4923278e1964" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "546f59fe-a233-4002-b737-4923278e1964" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:04:09 user nova-compute[75020]: INFO nova.compute.claims [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Claim successful on node user
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:04:09 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:04:09 user nova-compute[75020]: DEBUG nova.policy [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007c1fe9701d4950a6f3e69faea04afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0273db32a544b7861db7e9c230b963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:04:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Creating image(s)
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "/opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "/opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "/opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Successfully created port: 12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk 1073741824" returned: 0 in 0.074s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Cannot resize image /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Ensure instance console log exists: /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Successfully updated port: 12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "refresh_cache-546f59fe-a233-4002-b737-4923278e1964" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquired lock "refresh_cache-546f59fe-a233-4002-b737-4923278e1964" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-76019d39-9cdf-4a8a-8820-de9a1bb8f384 req-ede75ce4-5d7b-48c2-a8f4-0d080a0f6a8f service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received event network-changed-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-76019d39-9cdf-4a8a-8820-de9a1bb8f384 req-ede75ce4-5d7b-48c2-a8f4-0d080a0f6a8f service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Refreshing instance network info cache due to event network-changed-12e649ca-debd-4764-9206-338cfa142e58. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-76019d39-9cdf-4a8a-8820-de9a1bb8f384 req-ede75ce4-5d7b-48c2-a8f4-0d080a0f6a8f service nova] Acquiring lock "refresh_cache-546f59fe-a233-4002-b737-4923278e1964" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Updating instance_info_cache with network_info: [{"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Releasing lock "refresh_cache-546f59fe-a233-4002-b737-4923278e1964" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Instance network_info: |[{"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-76019d39-9cdf-4a8a-8820-de9a1bb8f384 req-ede75ce4-5d7b-48c2-a8f4-0d080a0f6a8f service nova] Acquired lock "refresh_cache-546f59fe-a233-4002-b737-4923278e1964" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-76019d39-9cdf-4a8a-8820-de9a1bb8f384 req-ede75ce4-5d7b-48c2-a8f4-0d080a0f6a8f service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Refreshing network info cache for port 12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Start _get_guest_xml network_info=[{"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:04:11 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:04:11 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1089886492',display_name='tempest-VolumesActionsTest-instance-1089886492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1089886492',id=34,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef0273db32a544b7861db7e9c230b963',ramdisk_id='',reservation_id='r-6ugg0jag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1089300411',owner_user_name='tempest-VolumesActionsTest-1089300411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:04:10Z,user_data=None,user_id='007c1fe9701d4950a6f3e69faea04afc',uuid=546f59fe-a233-4002-b737-4923278e1964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converting VIF {"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:de:11,bridge_name='br-int',has_traffic_filtering=True,id=12e649ca-debd-4764-9206-338cfa142e58,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e649ca-de') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lazy-loading 'pci_devices' on Instance uuid 546f59fe-a233-4002-b737-4923278e1964 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:04:11 user nova-compute[75020]:   <uuid>546f59fe-a233-4002-b737-4923278e1964</uuid>
Nov 30 11:04:11 user nova-compute[75020]:   <name>instance-00000022</name>
Nov 30 11:04:11 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:04:11 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:04:11 user nova-compute[75020]:   <metadata>
Nov 30 11:04:11 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:04:11 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:04:11 user nova-compute[75020]:       <nova:name>tempest-VolumesActionsTest-instance-1089886492</nova:name>
Nov 30 11:04:11 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:04:11</nova:creationTime>
Nov 30 11:04:11 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:04:11 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:04:11 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:04:11 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:04:11 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:04:11 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:04:11 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:04:11 user nova-compute[75020]:       <nova:owner>
Nov 30 11:04:11 user nova-compute[75020]:         <nova:user uuid="007c1fe9701d4950a6f3e69faea04afc">tempest-VolumesActionsTest-1089300411-project-member</nova:user>
Nov 30 11:04:11 user nova-compute[75020]:         <nova:project uuid="ef0273db32a544b7861db7e9c230b963">tempest-VolumesActionsTest-1089300411</nova:project>
Nov 30 11:04:11 user nova-compute[75020]:       </nova:owner>
Nov 30 11:04:11 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:04:11 user nova-compute[75020]:       <nova:ports>
Nov 30 11:04:11 user nova-compute[75020]:         <nova:port uuid="12e649ca-debd-4764-9206-338cfa142e58">
Nov 30 11:04:11 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 11:04:11 user nova-compute[75020]:         </nova:port>
Nov 30 11:04:11 user nova-compute[75020]:       </nova:ports>
Nov 30 11:04:11 user nova-compute[75020]:     </nova:instance>
Nov 30 11:04:11 user nova-compute[75020]:   </metadata>
Nov 30 11:04:11 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:04:11 user nova-compute[75020]:     <system>
Nov 30 11:04:11 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:04:11 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:04:11 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:04:11 user nova-compute[75020]:       <entry name="serial">546f59fe-a233-4002-b737-4923278e1964</entry>
Nov 30 11:04:11 user nova-compute[75020]:       <entry name="uuid">546f59fe-a233-4002-b737-4923278e1964</entry>
Nov 30 11:04:11 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:04:11 user nova-compute[75020]:     </system>
Nov 30 11:04:11 user nova-compute[75020]:   </sysinfo>
Nov 30 11:04:11 user nova-compute[75020]:   <os>
Nov 30 11:04:11 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:04:11 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:04:11 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:04:11 user nova-compute[75020]:   </os>
Nov 30 11:04:11 user nova-compute[75020]:   <features>
Nov 30 11:04:11 user nova-compute[75020]:     <acpi/>
Nov 30 11:04:11 user nova-compute[75020]:     <apic/>
Nov 30 11:04:11 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:04:11 user nova-compute[75020]:   </features>
Nov 30 11:04:11 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:04:11 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:04:11 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:04:11 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:04:11 user nova-compute[75020]:   </clock>
Nov 30 11:04:11 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:04:11 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:04:11 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:04:11 user nova-compute[75020]:   </cpu>
Nov 30 11:04:11 user nova-compute[75020]:   <devices>
Nov 30 11:04:11 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:04:11 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:04:11 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk"/>
Nov 30 11:04:11 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:04:11 user nova-compute[75020]:     </disk>
Nov 30 11:04:11 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:04:11 user nova-compute[75020]:       <mac address="fa:16:3e:24:de:11"/>
Nov 30 11:04:11 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:04:11 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:04:11 user nova-compute[75020]:       <target dev="tap12e649ca-de"/>
Nov 30 11:04:11 user nova-compute[75020]:     </interface>
Nov 30 11:04:11 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:04:11 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/console.log" append="off"/>
Nov 30 11:04:11 user nova-compute[75020]:     </serial>
Nov 30 11:04:11 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:04:11 user nova-compute[75020]:     <video>
Nov 30 11:04:11 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:04:11 user nova-compute[75020]:     </video>
Nov 30 11:04:11 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:04:11 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:04:11 user nova-compute[75020]:     </rng>
Nov 30 11:04:11 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:04:11 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:04:11 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:04:11 user nova-compute[75020]:     </memballoon>
Nov 30 11:04:11 user nova-compute[75020]:   </devices>
Nov 30 11:04:11 user nova-compute[75020]: </domain>
Nov 30 11:04:11 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1089886492',display_name='tempest-VolumesActionsTest-instance-1089886492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1089886492',id=34,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef0273db32a544b7861db7e9c230b963',ramdisk_id='',reservation_id='r-6ugg0jag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1089300411',owner_user_name='tempest-VolumesActionsTest-1089300411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:04:10Z,user_data=None,user_id='007c1fe9701d4950a6f3e69faea04afc',uuid=546f59fe-a233-4002-b737-4923278e1964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converting VIF {"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:de:11,bridge_name='br-int',has_traffic_filtering=True,id=12e649ca-debd-4764-9206-338cfa142e58,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e649ca-de') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG os_vif [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:de:11,bridge_name='br-int',has_traffic_filtering=True,id=12e649ca-debd-4764-9206-338cfa142e58,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e649ca-de') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '324bf545-4688-5910-ae8d-854b2430f738', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12e649ca-de, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12e649ca-de, col_values=(('qos', UUID('7c97777d-00e8-4a50-a926-c6d595001222')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12e649ca-de, col_values=(('external_ids', {'iface-id': '12e649ca-debd-4764-9206-338cfa142e58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:de:11', 'vm-uuid': '546f59fe-a233-4002-b737-4923278e1964'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:11 user nova-compute[75020]: INFO os_vif [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:de:11,bridge_name='br-int',has_traffic_filtering=True,id=12e649ca-debd-4764-9206-338cfa142e58,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e649ca-de')
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] No VIF found with MAC fa:16:3e:24:de:11, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-76019d39-9cdf-4a8a-8820-de9a1bb8f384 req-ede75ce4-5d7b-48c2-a8f4-0d080a0f6a8f service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Updated VIF entry in instance network info cache for port 12e649ca-debd-4764-9206-338cfa142e58. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG nova.network.neutron [req-76019d39-9cdf-4a8a-8820-de9a1bb8f384 req-ede75ce4-5d7b-48c2-a8f4-0d080a0f6a8f service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Updating instance_info_cache with network_info: [{"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-76019d39-9cdf-4a8a-8820-de9a1bb8f384 req-ede75ce4-5d7b-48c2-a8f4-0d080a0f6a8f service nova] Releasing lock "refresh_cache-546f59fe-a233-4002-b737-4923278e1964" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:04:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-b6d006d7-5361-4ddf-be10-d9ecdcbd4815 req-cc6b4a20-efc0-4781-bdd2-20e6493e3eae service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received event network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b6d006d7-5361-4ddf-be10-d9ecdcbd4815 req-cc6b4a20-efc0-4781-bdd2-20e6493e3eae service nova] Acquiring lock "546f59fe-a233-4002-b737-4923278e1964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b6d006d7-5361-4ddf-be10-d9ecdcbd4815 req-cc6b4a20-efc0-4781-bdd2-20e6493e3eae service nova] Lock "546f59fe-a233-4002-b737-4923278e1964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b6d006d7-5361-4ddf-be10-d9ecdcbd4815 req-cc6b4a20-efc0-4781-bdd2-20e6493e3eae service nova] Lock "546f59fe-a233-4002-b737-4923278e1964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-b6d006d7-5361-4ddf-be10-d9ecdcbd4815 req-cc6b4a20-efc0-4781-bdd2-20e6493e3eae service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] No waiting events found dispatching network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:04:13 user nova-compute[75020]: WARNING nova.compute.manager [req-b6d006d7-5361-4ddf-be10-d9ecdcbd4815 req-cc6b4a20-efc0-4781-bdd2-20e6493e3eae service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received unexpected event network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 for instance with vm_state building and task_state spawning.
Nov 30 11:04:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.compute.manager [req-affd810a-2140-44ed-a6f8-0749fb2372a8 req-1af3a32a-521e-44c1-a898-a52d90358a74 service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received event network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-affd810a-2140-44ed-a6f8-0749fb2372a8 req-1af3a32a-521e-44c1-a898-a52d90358a74 service nova] Acquiring lock "546f59fe-a233-4002-b737-4923278e1964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-affd810a-2140-44ed-a6f8-0749fb2372a8 req-1af3a32a-521e-44c1-a898-a52d90358a74 service nova] Lock "546f59fe-a233-4002-b737-4923278e1964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-affd810a-2140-44ed-a6f8-0749fb2372a8 req-1af3a32a-521e-44c1-a898-a52d90358a74 service nova] Lock "546f59fe-a233-4002-b737-4923278e1964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.compute.manager [req-affd810a-2140-44ed-a6f8-0749fb2372a8 req-1af3a32a-521e-44c1-a898-a52d90358a74 service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] No waiting events found dispatching network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:04:15 user nova-compute[75020]: WARNING nova.compute.manager [req-affd810a-2140-44ed-a6f8-0749fb2372a8 req-1af3a32a-521e-44c1-a898-a52d90358a74 service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received unexpected event network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 for instance with vm_state building and task_state spawning.
Nov 30 11:04:15 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 546f59fe-a233-4002-b737-4923278e1964] Instance spawned successfully.
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:04:15 user nova-compute[75020]: INFO nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 30 11:04:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:04:15 user nova-compute[75020]: INFO nova.compute.manager [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Took 6.14 seconds to build instance.
Nov 30 11:04:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8e52b0d9-0eef-4021-b7f3-8e2c91f433fb tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "546f59fe-a233-4002-b737-4923278e1964" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.252s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:28 user nova-compute[75020]: INFO nova.compute.manager [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Terminating instance
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.compute.manager [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Instance destroyed successfully.
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.objects.instance [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lazy-loading 'resources' on Instance uuid 35af8fb2-5ff1-4570-b0fb-042a49428b8b {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-3150f632-a818-4407-8105-c38316b37512 req-ab2479f4-7346-473b-b92f-087e4858b63f service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received event network-vif-unplugged-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3150f632-a818-4407-8105-c38316b37512 req-ab2479f4-7346-473b-b92f-087e4858b63f service nova] Acquiring lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3150f632-a818-4407-8105-c38316b37512 req-ab2479f4-7346-473b-b92f-087e4858b63f service nova] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3150f632-a818-4407-8105-c38316b37512 req-ab2479f4-7346-473b-b92f-087e4858b63f service nova] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-3150f632-a818-4407-8105-c38316b37512 req-ab2479f4-7346-473b-b92f-087e4858b63f service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] No waiting events found dispatching network-vif-unplugged-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-3150f632-a818-4407-8105-c38316b37512 req-ab2479f4-7346-473b-b92f-087e4858b63f service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received event network-vif-unplugged-ba4a921b-6834-4029-b659-dacd830a14d5 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2136257987',display_name='tempest-VolumesActionsTest-instance-2136257987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2136257987',id=31,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='801bc1fb7aae4784a7a42b091b2abb36',ramdisk_id='',reservation_id='r-fiyiy1ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1020938486',owner_user_name='tempest-VolumesActionsTest-1020938486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:02:36Z,user_data=None,user_id='21509ab3a62442a2acb7593f0cb7b7f8',uuid=35af8fb2-5ff1-4570-b0fb-042a49428b8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Converting VIF {"id": "ba4a921b-6834-4029-b659-dacd830a14d5", "address": "fa:16:3e:05:aa:97", "network": {"id": "45373c66-7fec-4fb4-b9a2-779640ddb41e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-488071147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801bc1fb7aae4784a7a42b091b2abb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4a921b-68", "ovs_interfaceid": "ba4a921b-6834-4029-b659-dacd830a14d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:aa:97,bridge_name='br-int',has_traffic_filtering=True,id=ba4a921b-6834-4029-b659-dacd830a14d5,network=Network(45373c66-7fec-4fb4-b9a2-779640ddb41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4a921b-68') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG os_vif [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:aa:97,bridge_name='br-int',has_traffic_filtering=True,id=ba4a921b-6834-4029-b659-dacd830a14d5,network=Network(45373c66-7fec-4fb4-b9a2-779640ddb41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4a921b-68') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4a921b-68, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fdc338f-b70b-42fd-920f-6217da85a403) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:04:28 user nova-compute[75020]: INFO os_vif [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:aa:97,bridge_name='br-int',has_traffic_filtering=True,id=ba4a921b-6834-4029-b659-dacd830a14d5,network=Network(45373c66-7fec-4fb4-b9a2-779640ddb41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4a921b-68')
Nov 30 11:04:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Deleting instance files /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b_del
Nov 30 11:04:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Deletion of /opt/stack/data/nova/instances/35af8fb2-5ff1-4570-b0fb-042a49428b8b_del complete
Nov 30 11:04:28 user nova-compute[75020]: INFO nova.compute.manager [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 30 11:04:28 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:04:28 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:04:29 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:29 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Took 0.59 seconds to deallocate network for instance.
Nov 30 11:04:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-c2a1f957-b28c-494c-bd83-91bf50af245f req-ad156d1a-a08e-49e5-b381-1d4df3342c1a service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received event network-vif-deleted-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:29 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:04:29 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:04:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:29 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Deleted allocations for instance 35af8fb2-5ff1-4570-b0fb-042a49428b8b
Nov 30 11:04:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-1374fd26-c9ee-4cb0-90ba-a5121dedcb55 tempest-VolumesActionsTest-1020938486 tempest-VolumesActionsTest-1020938486-project-member] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.015s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-1ae2b185-45c4-4e49-86c0-adff5bc47909 req-21bce755-2300-4b17-8525-59d1dec77cf7 service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received event network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ae2b185-45c4-4e49-86c0-adff5bc47909 req-21bce755-2300-4b17-8525-59d1dec77cf7 service nova] Acquiring lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ae2b185-45c4-4e49-86c0-adff5bc47909 req-21bce755-2300-4b17-8525-59d1dec77cf7 service nova] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ae2b185-45c4-4e49-86c0-adff5bc47909 req-21bce755-2300-4b17-8525-59d1dec77cf7 service nova] Lock "35af8fb2-5ff1-4570-b0fb-042a49428b8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-1ae2b185-45c4-4e49-86c0-adff5bc47909 req-21bce755-2300-4b17-8525-59d1dec77cf7 service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] No waiting events found dispatching network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:04:30 user nova-compute[75020]: WARNING nova.compute.manager [req-1ae2b185-45c4-4e49-86c0-adff5bc47909 req-21bce755-2300-4b17-8525-59d1dec77cf7 service nova] [instance: 35af8fb2-5ff1-4570-b0fb-042a49428b8b] Received unexpected event network-vif-plugged-ba4a921b-6834-4029-b659-dacd830a14d5 for instance with vm_state deleted and task_state None.
Nov 30 11:04:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-57dc2c1f-6b4a-428b-8bf3-83af843d30ba req-abc87792-4686-4c59-aa31-7cac46774ef6 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received event network-changed-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-57dc2c1f-6b4a-428b-8bf3-83af843d30ba req-abc87792-4686-4c59-aa31-7cac46774ef6 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Refreshing instance network info cache due to event network-changed-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-57dc2c1f-6b4a-428b-8bf3-83af843d30ba req-abc87792-4686-4c59-aa31-7cac46774ef6 service nova] Acquiring lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-57dc2c1f-6b4a-428b-8bf3-83af843d30ba req-abc87792-4686-4c59-aa31-7cac46774ef6 service nova] Acquired lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-57dc2c1f-6b4a-428b-8bf3-83af843d30ba req-abc87792-4686-4c59-aa31-7cac46774ef6 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Refreshing network info cache for port 225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:37 user nova-compute[75020]: INFO nova.compute.manager [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Terminating instance
Nov 30 11:04:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-57dc2c1f-6b4a-428b-8bf3-83af843d30ba req-abc87792-4686-4c59-aa31-7cac46774ef6 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Updated VIF entry in instance network info cache for port 225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:04:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-57dc2c1f-6b4a-428b-8bf3-83af843d30ba req-abc87792-4686-4c59-aa31-7cac46774ef6 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Updating instance_info_cache with network_info: [{"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-57dc2c1f-6b4a-428b-8bf3-83af843d30ba req-abc87792-4686-4c59-aa31-7cac46774ef6 service nova] Releasing lock "refresh_cache-ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-d76f2f56-3a49-4f19-9e66-d65a75aca04d req-6cec5a8e-1b9f-4f59-8352-7fb6f2c5027f service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received event network-vif-unplugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d76f2f56-3a49-4f19-9e66-d65a75aca04d req-6cec5a8e-1b9f-4f59-8352-7fb6f2c5027f service nova] Acquiring lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d76f2f56-3a49-4f19-9e66-d65a75aca04d req-6cec5a8e-1b9f-4f59-8352-7fb6f2c5027f service nova] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d76f2f56-3a49-4f19-9e66-d65a75aca04d req-6cec5a8e-1b9f-4f59-8352-7fb6f2c5027f service nova] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-d76f2f56-3a49-4f19-9e66-d65a75aca04d req-6cec5a8e-1b9f-4f59-8352-7fb6f2c5027f service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] No waiting events found dispatching network-vif-unplugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-d76f2f56-3a49-4f19-9e66-d65a75aca04d req-6cec5a8e-1b9f-4f59-8352-7fb6f2c5027f service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received event network-vif-unplugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Instance destroyed successfully.
Nov 30 11:04:38 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'resources' on Instance uuid ccf0a65b-e4a1-4606-aa36-eda1f07c2e14 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-706934598',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-706934598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-706934598',id=32,image_ref='4d964f34-dc8a-49c3-bfe0-9758ec581374',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDGeEYWyZDt7xIk2t5WpnSfLLA2YO/910Kf0Ys7mNnMHFmCGaFCFp7JeN8H29IkOxW/6KlLY0UD7KFQ3Ia6Hy1CMAmCK4xNH1a5kWVplvorFO+2b4AyPIdR4Z96ZVptLA==',key_name='tempest-keypair-1553440530',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-hil5isry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1120216767',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19afae8899f440c78b8a442361d5b531',uuid=ccf0a65b-e4a1-4606-aa36-eda1f07c2e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "address": "fa:16:3e:ab:c3:78", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225b4e7a-78", "ovs_interfaceid": "225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225b4e7a-78') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_vif [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225b4e7a-78') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap225b4e7a-78, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcf6fc05-073c-415f-a326-1e476a0bae10) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: INFO os_vif [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225b4e7a-78')
Nov 30 11:04:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRredyit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:04:38 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad3c8fa-c25f-4305-8a16-9849cc113a76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:04:38 user nova-compute[75020]: No targets found.
Nov 30 11:04:38 user nova-compute[75020]: iSNS:
Nov 30 11:04:38 user nova-compute[75020]: No targets found.
Nov 30 11:04:38 user nova-compute[75020]: STATIC:
Nov 30 11:04:38 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06
Nov 30 11:04:38 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:38 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:38 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead
Nov 30 11:04:38 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:38 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:38 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059
Nov 30 11:04:38 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:38 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:38 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15
Nov 30 11:04:38 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:38 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:38 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:04:38 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:38 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:38 user nova-compute[75020]: FIRMWARE:
Nov 30 11:04:38 user nova-compute[75020]: No targets found.
Nov 30 11:04:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:04:38 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:04:38 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc473df-c2da-44cb-a63b-9e4d08569286]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8bc885-2ae9-4707-b158-e4f23f2500b5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:04:38 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:04:38 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:04:38 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:04:38 user nova-compute[75020]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 (non-flash)
Nov 30 11:04:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:04:38 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:04:38 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:04:38 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:04:38 user nova-compute[75020]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 (non-flash)
Nov 30 11:04:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad886789d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a801fe-5c09-4bb6-8413-9e21595128e1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d768ab44-4596-4e55-865d-f177c431f199]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[06148afb-bd15-4d90-b279-573b6e8eaa68]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae15c3d1-15a2-4cab-9021-37cefca82ecc]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_88d509ed',) {{(pid=86371) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bac2a5-b9eb-4e8a-b6f0-8339d6591e0c]: (4, None) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a08d4-d6f3-466b-a6f8-e6ec4950e385]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c026c3ff-950e-4c39-8bc5-b958c3d5c4c0]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059, portal: 172.16.0.220,3260]
Nov 30 11:04:38 user nova-compute[75020]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059, portal: 172.16.0.220,3260] successful.
Nov 30 11:04:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f4a094-3d74-46dc-9373-62d3127c3059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70ecc8b-3808-430d-a41a-9de072b9450c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:04:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:04:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== disconnect_volume: return (342ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:04:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:04:39 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Deleting instance files /opt/stack/data/nova/instances/ccf0a65b-e4a1-4606-aa36-eda1f07c2e14_del
Nov 30 11:04:39 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Deletion of /opt/stack/data/nova/instances/ccf0a65b-e4a1-4606-aa36-eda1f07c2e14_del complete
Nov 30 11:04:39 user nova-compute[75020]: INFO nova.compute.manager [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 30 11:04:39 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:04:39 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:04:39 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:04:39 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-ff44f850-49a5-4aab-9716-be318a2b3b5b req-359289e5-c320-462b-bbbc-f61590747678 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received event network-vif-deleted-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:39 user nova-compute[75020]: INFO nova.compute.manager [req-ff44f850-49a5-4aab-9716-be318a2b3b5b req-359289e5-c320-462b-bbbc-f61590747678 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Neutron deleted interface 225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4; detaching it from the instance and deleting it from the info cache
Nov 30 11:04:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-ff44f850-49a5-4aab-9716-be318a2b3b5b req-359289e5-c320-462b-bbbc-f61590747678 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:39 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Took 0.88 seconds to deallocate network for instance.
Nov 30 11:04:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-ff44f850-49a5-4aab-9716-be318a2b3b5b req-359289e5-c320-462b-bbbc-f61590747678 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Detach interface failed, port_id=225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4, reason: Instance ccf0a65b-e4a1-4606-aa36-eda1f07c2e14 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 11:04:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-69403f4a-e6d5-443e-b8bd-7923228a7e88 req-d84ed4f3-d160-4004-9496-a1f4d18f3525 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received event network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69403f4a-e6d5-443e-b8bd-7923228a7e88 req-d84ed4f3-d160-4004-9496-a1f4d18f3525 service nova] Acquiring lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69403f4a-e6d5-443e-b8bd-7923228a7e88 req-d84ed4f3-d160-4004-9496-a1f4d18f3525 service nova] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-69403f4a-e6d5-443e-b8bd-7923228a7e88 req-d84ed4f3-d160-4004-9496-a1f4d18f3525 service nova] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-69403f4a-e6d5-443e-b8bd-7923228a7e88 req-d84ed4f3-d160-4004-9496-a1f4d18f3525 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] No waiting events found dispatching network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:04:40 user nova-compute[75020]: WARNING nova.compute.manager [req-69403f4a-e6d5-443e-b8bd-7923228a7e88 req-d84ed4f3-d160-4004-9496-a1f4d18f3525 service nova] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Received unexpected event network-vif-plugged-225b4e7a-788f-42cc-b2ce-fca4ac3c1fb4 for instance with vm_state active and task_state deleting.
Nov 30 11:04:40 user nova-compute[75020]: INFO nova.compute.manager [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Took 0.82 seconds to detach 1 volumes for instance.
Nov 30 11:04:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: ccf0a65b-e4a1-4606-aa36-eda1f07c2e14] Deleting volume: 92f4a094-3d74-46dc-9373-62d3127c3059 {{(pid=75020) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 11:04:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Deleted allocations for instance ccf0a65b-e4a1-4606-aa36-eda1f07c2e14
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e182ee69-e0d5-4369-a502-7c06483cc04c tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "ccf0a65b-e4a1-4606-aa36-eda1f07c2e14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.542s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid d88214a8-f7f1-4735-8faf-611d70a77d9f {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 1c7e9069-f20d-4389-bbe9-5b3702d408e5 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid df6c4dec-55bd-4b90-acd4-391e4c17d147 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 79fe1d49-08c7-4197-a6b6-7f7dc4500487 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 08b79baf-8036-4ac4-856d-b7dbce524ec3 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 546f59fe-a233-4002-b737-4923278e1964 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "9768f14b-9e34-421e-be7c-e541442814e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "13d43551-5590-4e96-a197-fe2556e080c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "492f3123-e679-4a6c-a134-6c7912054463" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "546f59fe-a233-4002-b737-4923278e1964" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "546f59fe-a233-4002-b737-4923278e1964" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "9768f14b-9e34-421e-be7c-e541442814e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "13d43551-5590-4e96-a197-fe2556e080c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "492f3123-e679-4a6c-a134-6c7912054463" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "546f59fe-a233-4002-b737-4923278e1964" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updating instance_info_cache with network_info: [{"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "492f3123-e679-4a6c-a134-6c7912054463" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:50 user nova-compute[75020]: INFO nova.compute.manager [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Terminating instance
Nov 30 11:04:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-3ab8b3fd-5abb-4b29-9235-2246a842ad18 req-52288cd5-7970-4ac9-b196-fa1aa19a3955 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3ab8b3fd-5abb-4b29-9235-2246a842ad18 req-52288cd5-7970-4ac9-b196-fa1aa19a3955 service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3ab8b3fd-5abb-4b29-9235-2246a842ad18 req-52288cd5-7970-4ac9-b196-fa1aa19a3955 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3ab8b3fd-5abb-4b29-9235-2246a842ad18 req-52288cd5-7970-4ac9-b196-fa1aa19a3955 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-3ab8b3fd-5abb-4b29-9235-2246a842ad18 req-52288cd5-7970-4ac9-b196-fa1aa19a3955 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-3ab8b3fd-5abb-4b29-9235-2246a842ad18 req-52288cd5-7970-4ac9-b196-fa1aa19a3955 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-unplugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Instance destroyed successfully.
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.objects.instance [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'resources' on Instance uuid 492f3123-e679-4a6c-a134-6c7912054463 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-745636477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-745636477',id=27,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-cttz0m7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:03:05Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=492f3123-e679-4a6c-a134-6c7912054463,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "address": "fa:16:3e:94:99:3d", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c71a3-cf", "ovs_interfaceid": "5f3c71a3-cf0b-4895-a021-ef8d3969b3b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:99:3d,bridge_name='br-int',has_traffic_filtering=True,id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c71a3-cf') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_vif [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:99:3d,bridge_name='br-int',has_traffic_filtering=True,id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c71a3-cf') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f3c71a3-cf, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89c09fd7-9a38-43a0-9d3d-729d4593b32d) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:04:51 user nova-compute[75020]: INFO os_vif [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:99:3d,bridge_name='br-int',has_traffic_filtering=True,id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c71a3-cf')
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtHYEywf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:04:51 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6359c57a-1011-4395-9f54-778a37351aad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:04:51 user nova-compute[75020]: No targets found.
Nov 30 11:04:51 user nova-compute[75020]: iSNS:
Nov 30 11:04:51 user nova-compute[75020]: No targets found.
Nov 30 11:04:51 user nova-compute[75020]: STATIC:
Nov 30 11:04:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06
Nov 30 11:04:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead
Nov 30 11:04:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15
Nov 30 11:04:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:04:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:04:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:04:51 user nova-compute[75020]: FIRMWARE:
Nov 30 11:04:51 user nova-compute[75020]: No targets found.
Nov 30 11:04:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:04:51 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:04:51 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[039989af-2e2d-46a1-a70a-597facb709e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[121c1c62-f808-4565-8b76-71a3f2a7cfcd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:04:51 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:04:51 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:04:51 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:04:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:04:51 user nova-compute[75020]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 (non-flash)
Nov 30 11:04:51 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:04:51 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:04:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada86e9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15'): ({'sdd'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Removing single pathed devices sdd {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f5ea7-fd54-4d9b-ab47-c418952bb97a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[165054b9-4b9b-45f5-960a-ac63570870ef]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flushing IO for device /dev/sdd {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[04304f42-c56c-4060-92df-5fcbeec95b8c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed4648-08f7-4f75-912a-2ea9811a771e]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3f5b2583-8cdc7347e8e28b3e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3f5b2583', '/dev/disk/by-id/scsi-23863646337333437') {{(pid=86371) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69231fd-ca38-42ff-9723-ec47d9b82a6c]: (4, None) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4d4623-0084-4d64-b947-c1d186f4e23b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e35e5d9-f1b9-496a-b4ef-a6998f26d606]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15, portal: 172.16.0.220,3260]
Nov 30 11:04:51 user nova-compute[75020]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15, portal: 172.16.0.220,3260] successful.
Nov 30 11:04:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b258d561-61a3-4f4a-8731-f7bf0f714e15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8df256c-aa34-4cde-96ef-2f5ed7ab0234]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] <== disconnect_volume: return (311ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:04:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:04:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Deleting instance files /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463_del
Nov 30 11:04:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Deletion of /opt/stack/data/nova/instances/492f3123-e679-4a6c-a134-6c7912054463_del complete
Nov 30 11:04:52 user nova-compute[75020]: INFO nova.compute.manager [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 30 11:04:52 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:04:52 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:04:52 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:04:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:52 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:52 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Took 0.42 seconds to deallocate network for instance.
Nov 30 11:04:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-e997d643-73a9-4546-96b1-ab01f60448e8 req-228440ad-2899-4864-a1d3-118e453e5541 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-deleted-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:52 user nova-compute[75020]: INFO nova.compute.manager [req-e997d643-73a9-4546-96b1-ab01f60448e8 req-228440ad-2899-4864-a1d3-118e453e5541 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Neutron deleted interface 5f3c71a3-cf0b-4895-a021-ef8d3969b3b0; detaching it from the instance and deleting it from the info cache
Nov 30 11:04:52 user nova-compute[75020]: DEBUG nova.network.neutron [req-e997d643-73a9-4546-96b1-ab01f60448e8 req-228440ad-2899-4864-a1d3-118e453e5541 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:04:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-e997d643-73a9-4546-96b1-ab01f60448e8 req-228440ad-2899-4864-a1d3-118e453e5541 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Detach interface failed, port_id=5f3c71a3-cf0b-4895-a021-ef8d3969b3b0, reason: Instance 492f3123-e679-4a6c-a134-6c7912054463 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:53 user nova-compute[75020]: INFO nova.compute.manager [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Took 0.79 seconds to detach 1 volumes for instance.
Nov 30 11:04:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-a4ddf85c-0679-4bf3-b5b5-520dc9c69c47 req-d18b7ad4-148e-4680-b5fd-df28701c60a3 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a4ddf85c-0679-4bf3-b5b5-520dc9c69c47 req-d18b7ad4-148e-4680-b5fd-df28701c60a3 service nova] Acquiring lock "492f3123-e679-4a6c-a134-6c7912054463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a4ddf85c-0679-4bf3-b5b5-520dc9c69c47 req-d18b7ad4-148e-4680-b5fd-df28701c60a3 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a4ddf85c-0679-4bf3-b5b5-520dc9c69c47 req-d18b7ad4-148e-4680-b5fd-df28701c60a3 service nova] Lock "492f3123-e679-4a6c-a134-6c7912054463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-a4ddf85c-0679-4bf3-b5b5-520dc9c69c47 req-d18b7ad4-148e-4680-b5fd-df28701c60a3 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] No waiting events found dispatching network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:04:53 user nova-compute[75020]: WARNING nova.compute.manager [req-a4ddf85c-0679-4bf3-b5b5-520dc9c69c47 req-d18b7ad4-148e-4680-b5fd-df28701c60a3 service nova] [instance: 492f3123-e679-4a6c-a134-6c7912054463] Received unexpected event network-vif-plugged-5f3c71a3-cf0b-4895-a021-ef8d3969b3b0 for instance with vm_state active and task_state deleting.
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:53 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Deleted allocations for instance 492f3123-e679-4a6c-a134-6c7912054463
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-48aaf043-dbfe-4c60-a8bc-cf0fba38a8f8 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "492f3123-e679-4a6c-a134-6c7912054463" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:04:56 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:04:56 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=7850MB free_disk=24.959625244140625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance df6c4dec-55bd-4b90-acd4-391e4c17d147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 08b79baf-8036-4ac4-856d-b7dbce524ec3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 546f59fe-a233-4002-b737-4923278e1964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:04:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:04:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:04:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:04:59 user nova-compute[75020]: INFO nova.compute.manager [None req-d4808297-7309-4f07-a209-03c1d45fb556 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Get console output
Nov 30 11:05:00 user nova-compute[75020]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 30 11:05:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-47bc1a38-93e9-4c01-9299-9272afe4fe76 req-de941664-4985-4566-b304-10db2fe4d319 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-changed-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-47bc1a38-93e9-4c01-9299-9272afe4fe76 req-de941664-4985-4566-b304-10db2fe4d319 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Refreshing instance network info cache due to event network-changed-903ec885-1189-4bde-be19-0d7cabee638e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:05:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-47bc1a38-93e9-4c01-9299-9272afe4fe76 req-de941664-4985-4566-b304-10db2fe4d319 service nova] Acquiring lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:05:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-47bc1a38-93e9-4c01-9299-9272afe4fe76 req-de941664-4985-4566-b304-10db2fe4d319 service nova] Acquired lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:05:25 user nova-compute[75020]: DEBUG nova.network.neutron [req-47bc1a38-93e9-4c01-9299-9272afe4fe76 req-de941664-4985-4566-b304-10db2fe4d319 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Refreshing network info cache for port 903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG nova.network.neutron [req-47bc1a38-93e9-4c01-9299-9272afe4fe76 req-de941664-4985-4566-b304-10db2fe4d319 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updated VIF entry in instance network info cache for port 903ec885-1189-4bde-be19-0d7cabee638e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG nova.network.neutron [req-47bc1a38-93e9-4c01-9299-9272afe4fe76 req-de941664-4985-4566-b304-10db2fe4d319 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-47bc1a38-93e9-4c01-9299-9272afe4fe76 req-de941664-4985-4566-b304-10db2fe4d319 service nova] Releasing lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG nova.objects.instance [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'flavor' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:26 user nova-compute[75020]: INFO nova.compute.manager [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Attaching volume e79b492c-9689-4b8c-b9b1-8365250b90f9 to /dev/vdb
Nov 30 11:05:27 user nova-compute[75020]: DEBUG os_brick.utils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5695152-547d-40bb-834a-a63bf3582e30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[15540e58-50bc-4396-8e48-a3eb2639faa3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6bb63f-89f4-4474-adfe-54afc4b7324f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbbec39-5ad6-495f-beaa-a1c6c308bee9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:05:27 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:05:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b169b92b-1845-4b59-be5f-1670a54ad435]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG os_brick.utils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:05:27 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating existing volume attachment record: 09f3f82e-4e1b-46e9-adc8-7ec302f55a10 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:05:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:35 user nova-compute[75020]: INFO nova.compute.manager [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Terminating instance
Nov 30 11:05:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-4c13912c-07ce-43c0-a4ac-cd35a6332a33 req-63bf472d-53a8-4174-b488-e573dfa4bcd3 service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received event network-vif-unplugged-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4c13912c-07ce-43c0-a4ac-cd35a6332a33 req-63bf472d-53a8-4174-b488-e573dfa4bcd3 service nova] Acquiring lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4c13912c-07ce-43c0-a4ac-cd35a6332a33 req-63bf472d-53a8-4174-b488-e573dfa4bcd3 service nova] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4c13912c-07ce-43c0-a4ac-cd35a6332a33 req-63bf472d-53a8-4174-b488-e573dfa4bcd3 service nova] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-4c13912c-07ce-43c0-a4ac-cd35a6332a33 req-63bf472d-53a8-4174-b488-e573dfa4bcd3 service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] No waiting events found dispatching network-vif-unplugged-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-4c13912c-07ce-43c0-a4ac-cd35a6332a33 req-63bf472d-53a8-4174-b488-e573dfa4bcd3 service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received event network-vif-unplugged-e0021916-7934-4154-b33c-b4c100e51448 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDuXrJnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:05:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:05:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:05:36 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ac55e-094b-4e8a-b291-f83065aba968]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:05:36 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2cc0f6-c1ff-4434-a34c-7ca01a6983a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9] added
Nov 30 11:05:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a400c0-d2c3-498d-a409-588a06f4080a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e44e38-2e19-4e22-9c0d-f02cfc51c387]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDuXrJnP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDuXrJnP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ae98f-1956-4cc9-921f-7fd1ebb5c729]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xDuXrJnP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a509a77-7bce-48cd-9457-ef8e12ee5f52]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:36 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Instance destroyed successfully.
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.objects.instance [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'resources' on Instance uuid 08b79baf-8036-4ac4-856d-b7dbce524ec3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-735717366',display_name='tempest-TestVolumeBootPattern-volume-backed-server-735717366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-735717366',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ+OQt0WFnBa0JpAcyHjrcQaEGMcDSr7/tjUekKH7cMQqLLdZgmfvbuqY0WcKCinO4Un8bznHXHymuRn6rtmwFsLuiGYiyZj4j1RBhrEZLgWqYqEysie9Mp0WJBRt4eIw==',key_name='tempest-keypair-414062164',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:01:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-sax1ba9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19afae8899f440c78b8a442361d5b531',uuid=08b79baf-8036-4ac4-856d-b7dbce524ec3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "e0021916-7934-4154-b33c-b4c100e51448", "address": "fa:16:3e:b3:47:00", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0021916-79", "ovs_interfaceid": "e0021916-7934-4154-b33c-b4c100e51448", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:47:00,bridge_name='br-int',has_traffic_filtering=True,id=e0021916-7934-4154-b33c-b4c100e51448,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0021916-79') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_vif [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:47:00,bridge_name='br-int',has_traffic_filtering=True,id=e0021916-7934-4154-b33c-b4c100e51448,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0021916-79') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c2cf9-3963-42e2-92fc-51bd56be2de7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:05:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:05:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0021916-79, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=681c2d98-15a6-45f7-957c-8e8eb9386986) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:36 user nova-compute[75020]: INFO os_vif [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:47:00,bridge_name='br-int',has_traffic_filtering=True,id=e0021916-7934-4154-b33c-b4c100e51448,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0021916-79')
Nov 30 11:05:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pchyjSfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:05:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1774b75f-798e-4f97-8ca5-30450acf1d2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9, portal: 172.16.0.220,3260]
Nov 30 11:05:36 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9, portal: 172.16.0.220,3260] successful.
Nov 30 11:05:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2f4a28-0acf-4cc2-bec0-5dd4d5bda54c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[53917027-627a-4216-b77b-7d84f27bf16e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:05:36 user nova-compute[75020]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:05:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b9ebc0-2c2e-4510-a54f-276b2890deac]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:05:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDuXrJnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23663393839633266', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663393839633266', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.123s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'flavor' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c34407-6178-4299-a4b5-45a8297095c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:05:37 user nova-compute[75020]: No targets found.
Nov 30 11:05:37 user nova-compute[75020]: iSNS:
Nov 30 11:05:37 user nova-compute[75020]: No targets found.
Nov 30 11:05:37 user nova-compute[75020]: STATIC:
Nov 30 11:05:37 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06
Nov 30 11:05:37 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:05:37 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:05:37 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead
Nov 30 11:05:37 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:05:37 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:05:37 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9
Nov 30 11:05:37 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:05:37 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:05:37 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:05:37 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:05:37 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:05:37 user nova-compute[75020]: FIRMWARE:
Nov 30 11:05:37 user nova-compute[75020]: No targets found.
Nov 30 11:05:37 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:05:37 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:05:37 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:05:37 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:05:37 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:05:37 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:05:37 user nova-compute[75020]:   <serial>e79b492c-9689-4b8c-b9b1-8365250b90f9</serial>
Nov 30 11:05:37 user nova-compute[75020]: </disk>
Nov 30 11:05:37 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aa501f-698b-4844-b353-288f17ca1849]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b76615-7d6f-4568-9c0f-afe7e3952412]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:05:37 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:05:37 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:05:37 user nova-compute[75020]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:05:37 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:05:37 user nova-compute[75020]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 (non-flash)
Nov 30 11:05:37 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:05:37 user nova-compute[75020]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:05:37 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad885fc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06'): ({'sdf'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Removing single pathed devices sdf {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf59817-6ee6-4646-be0a-02c48da44a8c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e6ab20-783f-47ed-bae2-161963fb53ad]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flushing IO for device /dev/sdf {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[235f848f-6ab2-44cf-9458-598f94c7ad46]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7110e-8a06-497f-9307-a8b2ec5008a5]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] SCSI volumes sdf have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caea507-b10d-419b-b6f5-5ded11c49a56]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d667a21-1f63-4264-805d-d16fc0041265]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06, portal: 172.16.0.220,3260]
Nov 30 11:05:37 user nova-compute[75020]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06, portal: 172.16.0.220,3260] successful.
Nov 30 11:05:37 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21095494-2701-4e0d-ac03-54fff2eabc06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d29632-56f7-43e9-8b4d-fba88800ffcf]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== disconnect_volume: return (1448ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:05:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Deleting instance files /opt/stack/data/nova/instances/08b79baf-8036-4ac4-856d-b7dbce524ec3_del
Nov 30 11:05:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Deletion of /opt/stack/data/nova/instances/08b79baf-8036-4ac4-856d-b7dbce524ec3_del complete
Nov 30 11:05:38 user nova-compute[75020]: INFO nova.compute.manager [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Took 2.36 seconds to destroy the instance on the hypervisor.
Nov 30 11:05:38 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-6ba61c47-53d2-4d51-8dda-0253ce14915d req-df0ae0b7-9626-4c15-86d3-ad0ba50c31bb service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received event network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6ba61c47-53d2-4d51-8dda-0253ce14915d req-df0ae0b7-9626-4c15-86d3-ad0ba50c31bb service nova] Acquiring lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6ba61c47-53d2-4d51-8dda-0253ce14915d req-df0ae0b7-9626-4c15-86d3-ad0ba50c31bb service nova] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6ba61c47-53d2-4d51-8dda-0253ce14915d req-df0ae0b7-9626-4c15-86d3-ad0ba50c31bb service nova] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-6ba61c47-53d2-4d51-8dda-0253ce14915d req-df0ae0b7-9626-4c15-86d3-ad0ba50c31bb service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] No waiting events found dispatching network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:38 user nova-compute[75020]: WARNING nova.compute.manager [req-6ba61c47-53d2-4d51-8dda-0253ce14915d req-df0ae0b7-9626-4c15-86d3-ad0ba50c31bb service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received unexpected event network-vif-plugged-e0021916-7934-4154-b33c-b4c100e51448 for instance with vm_state active and task_state deleting.
Nov 30 11:05:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No VIF found with MAC fa:16:3e:34:c2:c8, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:05:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9b045d32-e2b7-4cd6-9788-170c71b52c6b tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.501s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:39 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:05:39 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Took 0.95 seconds to deallocate network for instance.
Nov 30 11:05:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-26ff2916-032b-4181-b08e-784d669ec649 req-eb664e90-bf35-4243-8edc-3b109967da60 service nova] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Received event network-vif-deleted-e0021916-7934-4154-b33c-b4c100e51448 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:39 user nova-compute[75020]: INFO nova.compute.manager [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Rescuing
Nov 30 11:05:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:05:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquired lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:05:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:05:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:05:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Releasing lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:05:39 user nova-compute[75020]: INFO nova.compute.manager [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Took 0.94 seconds to detach 1 volumes for instance.
Nov 30 11:05:39 user nova-compute[75020]: DEBUG nova.compute.manager [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 08b79baf-8036-4ac4-856d-b7dbce524ec3] Deleting volume: 21095494-2701-4e0d-ac03-54fff2eabc06 {{(pid=75020) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:40 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Deleted allocations for instance 08b79baf-8036-4ac4-856d-b7dbce524ec3
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11bb3178-5774-4a98-b22a-d0d5c36563db tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "08b79baf-8036-4ac4-856d-b7dbce524ec3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.070s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance destroyed successfully.
Nov 30 11:05:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Attempting rescue
Nov 30 11:05:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75020) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance directory exists: not creating {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 11:05:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Creating image(s)
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG nova.objects.instance [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue" returned: 0 in 0.060s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'migration_context' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.base [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Start _get_guest_xml network_info=[{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:34:c2:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'resources' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:41 user nova-compute[75020]: WARNING nova.compute.manager [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state active and task_state rescuing.
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:41 user nova-compute[75020]: WARNING nova.compute.manager [req-64919245-8a2f-4aac-a5d3-7f73c3505305 req-e4429163-cc5b-465f-9333-7e2710612e34 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state active and task_state rescuing.
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.base [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'numa_topology' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.base [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:05:41 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:05:41 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.base [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2071756196',display_name='tempest-ServerRescueNegativeTestJSON-server-2071756196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2071756196',id=33,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuXk83Zzd7VusNvBjcbhIiGlQNKPBpumulr0zlrDK2/TWLgAPCvxATdCN65Fgva4S1jzF8fUTozTYSKQtaF6MDusWOL6TRQRk22LbSWdYxFuNqD7I4ecZDouVEay4u5kw==',key_name='tempest-keypair-251013875',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-auym15az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:34:c2:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "vif_mac": "fa:16:3e:34:c2:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:c2:c8,bridge_name='br-int',has_traffic_filtering=True,id=903ec885-1189-4bde-be19-0d7cabee638e,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903ec885-11') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'pci_devices' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.objects.base [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Object Instance<d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:05:41 user nova-compute[75020]:   <uuid>d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466</uuid>
Nov 30 11:05:41 user nova-compute[75020]:   <name>instance-00000021</name>
Nov 30 11:05:41 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:05:41 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:05:41 user nova-compute[75020]:   <metadata>
Nov 30 11:05:41 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:05:41 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:05:41 user nova-compute[75020]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2071756196</nova:name>
Nov 30 11:05:41 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:05:41</nova:creationTime>
Nov 30 11:05:41 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:05:41 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:05:41 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:05:41 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:05:41 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:05:41 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:05:41 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:05:41 user nova-compute[75020]:       <nova:owner>
Nov 30 11:05:41 user nova-compute[75020]:         <nova:user uuid="2cee10a54cf845a6a328df4e9ea4be85">tempest-ServerRescueNegativeTestJSON-2071093195-project-member</nova:user>
Nov 30 11:05:41 user nova-compute[75020]:         <nova:project uuid="8f16bf7c990e4b7c945642594b58584e">tempest-ServerRescueNegativeTestJSON-2071093195</nova:project>
Nov 30 11:05:41 user nova-compute[75020]:       </nova:owner>
Nov 30 11:05:41 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:05:41 user nova-compute[75020]:       <nova:ports>
Nov 30 11:05:41 user nova-compute[75020]:         <nova:port uuid="903ec885-1189-4bde-be19-0d7cabee638e">
Nov 30 11:05:41 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 11:05:41 user nova-compute[75020]:         </nova:port>
Nov 30 11:05:41 user nova-compute[75020]:       </nova:ports>
Nov 30 11:05:41 user nova-compute[75020]:     </nova:instance>
Nov 30 11:05:41 user nova-compute[75020]:   </metadata>
Nov 30 11:05:41 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:05:41 user nova-compute[75020]:     <system>
Nov 30 11:05:41 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:05:41 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:05:41 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:05:41 user nova-compute[75020]:       <entry name="serial">d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466</entry>
Nov 30 11:05:41 user nova-compute[75020]:       <entry name="uuid">d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466</entry>
Nov 30 11:05:41 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:05:41 user nova-compute[75020]:     </system>
Nov 30 11:05:41 user nova-compute[75020]:   </sysinfo>
Nov 30 11:05:41 user nova-compute[75020]:   <os>
Nov 30 11:05:41 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:05:41 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:05:41 user nova-compute[75020]:   </os>
Nov 30 11:05:41 user nova-compute[75020]:   <features>
Nov 30 11:05:41 user nova-compute[75020]:     <acpi/>
Nov 30 11:05:41 user nova-compute[75020]:     <apic/>
Nov 30 11:05:41 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:05:41 user nova-compute[75020]:   </features>
Nov 30 11:05:41 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:05:41 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:05:41 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:05:41 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:05:41 user nova-compute[75020]:   </clock>
Nov 30 11:05:41 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:05:41 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:05:41 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:05:41 user nova-compute[75020]:   </cpu>
Nov 30 11:05:41 user nova-compute[75020]:   <devices>
Nov 30 11:05:41 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:05:41 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:05:41 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue"/>
Nov 30 11:05:41 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:05:41 user nova-compute[75020]:     </disk>
Nov 30 11:05:41 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:05:41 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:05:41 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk"/>
Nov 30 11:05:41 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 11:05:41 user nova-compute[75020]:     </disk>
Nov 30 11:05:41 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:05:41 user nova-compute[75020]:       <mac address="fa:16:3e:34:c2:c8"/>
Nov 30 11:05:41 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:05:41 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:05:41 user nova-compute[75020]:       <target dev="tap903ec885-11"/>
Nov 30 11:05:41 user nova-compute[75020]:     </interface>
Nov 30 11:05:41 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:05:41 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/console.log" append="off"/>
Nov 30 11:05:41 user nova-compute[75020]:     </serial>
Nov 30 11:05:41 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:05:41 user nova-compute[75020]:     <video>
Nov 30 11:05:41 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:05:41 user nova-compute[75020]:     </video>
Nov 30 11:05:41 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:05:41 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:05:41 user nova-compute[75020]:     </rng>
Nov 30 11:05:41 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:05:41 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:05:41 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:05:41 user nova-compute[75020]:     </memballoon>
Nov 30 11:05:41 user nova-compute[75020]:   </devices>
Nov 30 11:05:41 user nova-compute[75020]: </domain>
Nov 30 11:05:41 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:05:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance destroyed successfully.
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] No VIF found with MAC fa:16:3e:34:c2:c8, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:41 user nova-compute[75020]: INFO nova.compute.manager [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Terminating instance
Nov 30 11:05:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-5c924a06-e752-4e53-b6e8-6fe7111f6b96 req-dc239972-d1f9-4f5c-862e-d5d96c795cd0 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-unplugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5c924a06-e752-4e53-b6e8-6fe7111f6b96 req-dc239972-d1f9-4f5c-862e-d5d96c795cd0 service nova] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5c924a06-e752-4e53-b6e8-6fe7111f6b96 req-dc239972-d1f9-4f5c-862e-d5d96c795cd0 service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5c924a06-e752-4e53-b6e8-6fe7111f6b96 req-dc239972-d1f9-4f5c-862e-d5d96c795cd0 service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-5c924a06-e752-4e53-b6e8-6fe7111f6b96 req-dc239972-d1f9-4f5c-862e-d5d96c795cd0 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] No waiting events found dispatching network-vif-unplugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-5c924a06-e752-4e53-b6e8-6fe7111f6b96 req-dc239972-d1f9-4f5c-862e-d5d96c795cd0 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-unplugged-0ed92ee1-069a-4881-8877-b0a79c610425 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Instance destroyed successfully.
Nov 30 11:05:43 user nova-compute[75020]: DEBUG nova.objects.instance [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'resources' on Instance uuid df6c4dec-55bd-4b90-acd4-391e4c17d147 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-882959482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-882959482',id=24,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:56:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-qj9v1uf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:58:15Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=df6c4dec-55bd-4b90-acd4-391e4c17d147,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "0ed92ee1-069a-4881-8877-b0a79c610425", "address": "fa:16:3e:88:79:7a", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed92ee1-06", "ovs_interfaceid": "0ed92ee1-069a-4881-8877-b0a79c610425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=0ed92ee1-069a-4881-8877-b0a79c610425,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed92ee1-06') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG os_vif [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=0ed92ee1-069a-4881-8877-b0a79c610425,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed92ee1-06') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ed92ee1-06, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5da95904-bbdc-4ee7-bd31-00c2d099a3e5) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: INFO os_vif [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=0ed92ee1-069a-4881-8877-b0a79c610425,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed92ee1-06')
Nov 30 11:05:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Deleting instance files /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147_del
Nov 30 11:05:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Deletion of /opt/stack/data/nova/instances/df6c4dec-55bd-4b90-acd4-391e4c17d147_del complete
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: INFO nova.compute.manager [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 30 11:05:43 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-3caddb47-bffb-4ad7-844e-f9ee58898fa8 req-cab12279-ae66-45bf-9b00-b64add5d0a15 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3caddb47-bffb-4ad7-844e-f9ee58898fa8 req-cab12279-ae66-45bf-9b00-b64add5d0a15 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3caddb47-bffb-4ad7-844e-f9ee58898fa8 req-cab12279-ae66-45bf-9b00-b64add5d0a15 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3caddb47-bffb-4ad7-844e-f9ee58898fa8 req-cab12279-ae66-45bf-9b00-b64add5d0a15 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-3caddb47-bffb-4ad7-844e-f9ee58898fa8 req-cab12279-ae66-45bf-9b00-b64add5d0a15 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:43 user nova-compute[75020]: WARNING nova.compute.manager [req-3caddb47-bffb-4ad7-844e-f9ee58898fa8 req-cab12279-ae66-45bf-9b00-b64add5d0a15 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state active and task_state rescuing.
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:05:44 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Took 0.73 seconds to deallocate network for instance.
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] No waiting events found dispatching network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:44 user nova-compute[75020]: WARNING nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received unexpected event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 for instance with vm_state active and task_state deleting.
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] No waiting events found dispatching network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:44 user nova-compute[75020]: WARNING nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received unexpected event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 for instance with vm_state active and task_state deleting.
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] No waiting events found dispatching network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:44 user nova-compute[75020]: WARNING nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received unexpected event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 for instance with vm_state active and task_state deleting.
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-unplugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] No waiting events found dispatching network-vif-unplugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-unplugged-0ed92ee1-069a-4881-8877-b0a79c610425 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Acquiring lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] No waiting events found dispatching network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:44 user nova-compute[75020]: WARNING nova.compute.manager [req-54db9335-b338-4fb4-81fc-c95ae94d98fe req-03a05442-bd33-4662-9293-fe336039e11e service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received unexpected event network-vif-plugged-0ed92ee1-069a-4881-8877-b0a79c610425 for instance with vm_state active and task_state deleting.
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:44 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Deleted allocations for instance df6c4dec-55bd-4b90-acd4-391e4c17d147
Nov 30 11:05:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-baf0f1eb-bb85-47c9-befe-5ca1d91d1123 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "df6c4dec-55bd-4b90-acd4-391e4c17d147" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.936s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-378c2cc2-89e3-4b48-aca2-c3f6c64289c2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:05:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-20e73e30-8892-47e0-8ae8-273a34c6b35c req-db85cb5b-9a1c-4971-be27-af486bf0e2f6 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-20e73e30-8892-47e0-8ae8-273a34c6b35c req-db85cb5b-9a1c-4971-be27-af486bf0e2f6 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-20e73e30-8892-47e0-8ae8-273a34c6b35c req-db85cb5b-9a1c-4971-be27-af486bf0e2f6 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-20e73e30-8892-47e0-8ae8-273a34c6b35c req-db85cb5b-9a1c-4971-be27-af486bf0e2f6 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-20e73e30-8892-47e0-8ae8-273a34c6b35c req-db85cb5b-9a1c-4971-be27-af486bf0e2f6 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:05:45 user nova-compute[75020]: WARNING nova.compute.manager [req-20e73e30-8892-47e0-8ae8-273a34c6b35c req-db85cb5b-9a1c-4971-be27-af486bf0e2f6 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state active and task_state rescuing.
Nov 30 11:05:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-20e73e30-8892-47e0-8ae8-273a34c6b35c req-db85cb5b-9a1c-4971-be27-af486bf0e2f6 service nova] [instance: df6c4dec-55bd-4b90-acd4-391e4c17d147] Received event network-vif-deleted-0ed92ee1-069a-4881-8877-b0a79c610425 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:05:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:05:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:05:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:05:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:05:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating instance_info_cache with network_info: [{"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:05:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-79fe1d49-08c7-4197-a6b6-7f7dc4500487" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:05:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:05:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:05:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:05:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:05:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:05:57 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:05:57 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8142MB free_disk=25.065940856933594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 9768f14b-9e34-421e-be7c-e541442814e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 546f59fe-a233-4002-b737-4923278e1964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:05:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:05:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:05:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:05:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "546f59fe-a233-4002-b737-4923278e1964" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "546f59fe-a233-4002-b737-4923278e1964" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "546f59fe-a233-4002-b737-4923278e1964-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "546f59fe-a233-4002-b737-4923278e1964-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "546f59fe-a233-4002-b737-4923278e1964-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:05:59 user nova-compute[75020]: INFO nova.compute.manager [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Terminating instance
Nov 30 11:05:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:05:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-a9b75458-388b-462d-9a86-a03c9edb2d3f req-9c54ec31-37ad-48cc-b811-ec233bb0a69c service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received event network-vif-unplugged-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9b75458-388b-462d-9a86-a03c9edb2d3f req-9c54ec31-37ad-48cc-b811-ec233bb0a69c service nova] Acquiring lock "546f59fe-a233-4002-b737-4923278e1964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9b75458-388b-462d-9a86-a03c9edb2d3f req-9c54ec31-37ad-48cc-b811-ec233bb0a69c service nova] Lock "546f59fe-a233-4002-b737-4923278e1964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9b75458-388b-462d-9a86-a03c9edb2d3f req-9c54ec31-37ad-48cc-b811-ec233bb0a69c service nova] Lock "546f59fe-a233-4002-b737-4923278e1964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-a9b75458-388b-462d-9a86-a03c9edb2d3f req-9c54ec31-37ad-48cc-b811-ec233bb0a69c service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] No waiting events found dispatching network-vif-unplugged-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-a9b75458-388b-462d-9a86-a03c9edb2d3f req-9c54ec31-37ad-48cc-b811-ec233bb0a69c service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received event network-vif-unplugged-12e649ca-debd-4764-9206-338cfa142e58 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:06:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 546f59fe-a233-4002-b737-4923278e1964] Instance destroyed successfully.
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.objects.instance [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lazy-loading 'resources' on Instance uuid 546f59fe-a233-4002-b737-4923278e1964 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1089886492',display_name='tempest-VolumesActionsTest-instance-1089886492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1089886492',id=34,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef0273db32a544b7861db7e9c230b963',ramdisk_id='',reservation_id='r-6ugg0jag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1089300411',owner_user_name='tempest-VolumesActionsTest-1089300411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:04:15Z,user_data=None,user_id='007c1fe9701d4950a6f3e69faea04afc',uuid=546f59fe-a233-4002-b737-4923278e1964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converting VIF {"id": "12e649ca-debd-4764-9206-338cfa142e58", "address": "fa:16:3e:24:de:11", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e649ca-de", "ovs_interfaceid": "12e649ca-debd-4764-9206-338cfa142e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:de:11,bridge_name='br-int',has_traffic_filtering=True,id=12e649ca-debd-4764-9206-338cfa142e58,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e649ca-de') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG os_vif [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:de:11,bridge_name='br-int',has_traffic_filtering=True,id=12e649ca-debd-4764-9206-338cfa142e58,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e649ca-de') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12e649ca-de, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c97777d-00e8-4a50-a926-c6d595001222) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:00 user nova-compute[75020]: INFO os_vif [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:de:11,bridge_name='br-int',has_traffic_filtering=True,id=12e649ca-debd-4764-9206-338cfa142e58,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e649ca-de')
Nov 30 11:06:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Deleting instance files /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964_del
Nov 30 11:06:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Deletion of /opt/stack/data/nova/instances/546f59fe-a233-4002-b737-4923278e1964_del complete
Nov 30 11:06:00 user nova-compute[75020]: INFO nova.compute.manager [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 546f59fe-a233-4002-b737-4923278e1964] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 546f59fe-a233-4002-b737-4923278e1964] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 546f59fe-a233-4002-b737-4923278e1964] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:00 user nova-compute[75020]: INFO nova.compute.manager [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Terminating instance
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:00 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 546f59fe-a233-4002-b737-4923278e1964] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:00 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 546f59fe-a233-4002-b737-4923278e1964] Took 0.56 seconds to deallocate network for instance.
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:01 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Deleted allocations for instance 546f59fe-a233-4002-b737-4923278e1964
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-e9d710c1-e13a-47a5-b250-f39d51aa8ef3 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "546f59fe-a233-4002-b737-4923278e1964" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.785s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Instance destroyed successfully.
Nov 30 11:06:01 user nova-compute[75020]: DEBUG nova.objects.instance [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'resources' on Instance uuid 79fe1d49-08c7-4197-a6b6-7f7dc4500487 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092003400',display_name='tempest-ServerActionsTestOtherA-server-1092003400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092003400',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:01:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-m0a6tv5a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=79fe1d49-08c7-4197-a6b6-7f7dc4500487,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "address": "fa:16:3e:fa:03:52", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd39b8a9-82", "ovs_interfaceid": "fd39b8a9-8223-43c9-9fa3-9b4bc9461edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_vif [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd39b8a9-82, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5181264-ccfc-4ba2-8a0f-c84ba6ce55dc) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:01 user nova-compute[75020]: INFO os_vif [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:52,bridge_name='br-int',has_traffic_filtering=True,id=fd39b8a9-8223-43c9-9fa3-9b4bc9461edf,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd39b8a9-82')
Nov 30 11:06:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVAphqHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:06:01 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e59144-99bb-4afd-a6b6-94981303fe91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:06:01 user nova-compute[75020]: No targets found.
Nov 30 11:06:01 user nova-compute[75020]: iSNS:
Nov 30 11:06:01 user nova-compute[75020]: No targets found.
Nov 30 11:06:01 user nova-compute[75020]: STATIC:
Nov 30 11:06:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead
Nov 30 11:06:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:06:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:06:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9
Nov 30 11:06:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:06:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:06:01 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:06:01 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:06:01 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:06:01 user nova-compute[75020]: FIRMWARE:
Nov 30 11:06:01 user nova-compute[75020]: No targets found.
Nov 30 11:06:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:06:01 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:06:01 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[69908272-243e-460c-8fb7-eea19147c01b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c73d7ac-34bc-4dd0-9dbb-1c46e2d16fe7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:06:01 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:06:01 user nova-compute[75020]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:06:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:06:01 user nova-compute[75020]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead (non-flash)
Nov 30 11:06:01 user nova-compute[75020]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:06:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88600820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3ba0ab-59eb-44ce-b9d1-e04883522c56]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b10e12-4674-4c12-89b6-49bb18cbd034]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[759f97cc-2045-4b87-8fef-181a22f1087f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[448742f1-9613-4a36-9fe2-5b888346840c]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_10633347', '/dev/disk/by-id/scsi-1SCST_BIO10633347-733b9fa23c492eb5', '/dev/disk/by-id/scsi-23733336239666132') {{(pid=86371) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c2385-f2b1-499b-9952-232004e6c4fa]: (4, None) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b056945-34db-4161-9447-e8f345a2d3da]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[93201f6d-51b9-48df-8640-9edb15b9d256]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260]
Nov 30 11:06:01 user nova-compute[75020]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead, portal: 172.16.0.220,3260] successful.
Nov 30 11:06:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948eb37d-9bff-42a3-92a5-0a1c41198ead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d04ae8-8929-47a7-9574-1587b4000179]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] <== disconnect_volume: return (351ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:06:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:06:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Deleting instance files /opt/stack/data/nova/instances/79fe1d49-08c7-4197-a6b6-7f7dc4500487_del
Nov 30 11:06:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Deletion of /opt/stack/data/nova/instances/79fe1d49-08c7-4197-a6b6-7f7dc4500487_del complete
Nov 30 11:06:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:02 user nova-compute[75020]: INFO nova.compute.manager [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received event network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Acquiring lock "546f59fe-a233-4002-b737-4923278e1964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Lock "546f59fe-a233-4002-b737-4923278e1964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Lock "546f59fe-a233-4002-b737-4923278e1964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] No waiting events found dispatching network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:02 user nova-compute[75020]: WARNING nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received unexpected event network-vif-plugged-12e649ca-debd-4764-9206-338cfa142e58 for instance with vm_state deleted and task_state None.
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 546f59fe-a233-4002-b737-4923278e1964] Received event network-vif-deleted-12e649ca-debd-4764-9206-338cfa142e58 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:02 user nova-compute[75020]: WARNING nova.compute.manager [req-3218e382-372b-4327-a08c-bd90c107a22f req-66909241-ba98-40d7-aacc-9c339aaa9c05 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state active and task_state deleting.
Nov 30 11:06:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:03 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:03 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Took 1.31 seconds to deallocate network for instance.
Nov 30 11:06:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:04 user nova-compute[75020]: WARNING nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state active and task_state deleting.
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:04 user nova-compute[75020]: WARNING nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state active and task_state deleting.
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-unplugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Acquiring lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] No waiting events found dispatching network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:04 user nova-compute[75020]: WARNING nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received unexpected event network-vif-plugged-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf for instance with vm_state active and task_state deleting.
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-72e5ed77-d3d2-49e8-b12d-d0bc006f17b4 req-15add56d-029c-41d9-917b-5fa5630de187 service nova] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Received event network-vif-deleted-fd39b8a9-8223-43c9-9fa3-9b4bc9461edf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:04 user nova-compute[75020]: INFO nova.compute.manager [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Took 0.84 seconds to detach 1 volumes for instance.
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 79fe1d49-08c7-4197-a6b6-7f7dc4500487] Deleting volume: 948eb37d-9bff-42a3-92a5-0a1c41198ead {{(pid=75020) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:04 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Deleted allocations for instance 79fe1d49-08c7-4197-a6b6-7f7dc4500487
Nov 30 11:06:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-11ee9766-294d-467d-8a6c-40ec45a3b896 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "79fe1d49-08c7-4197-a6b6-7f7dc4500487" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.965s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:06:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:06:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:06:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "9768f14b-9e34-421e-be7c-e541442814e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:32 user nova-compute[75020]: INFO nova.compute.manager [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Terminating instance
Nov 30 11:06:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG nova.compute.manager [req-9a78bb03-55be-4cb4-ac07-fd8187273285 req-fd6c7d3e-141a-410a-97be-c1577d72d980 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9a78bb03-55be-4cb4-ac07-fd8187273285 req-fd6c7d3e-141a-410a-97be-c1577d72d980 service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9a78bb03-55be-4cb4-ac07-fd8187273285 req-fd6c7d3e-141a-410a-97be-c1577d72d980 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9a78bb03-55be-4cb4-ac07-fd8187273285 req-fd6c7d3e-141a-410a-97be-c1577d72d980 service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG nova.compute.manager [req-9a78bb03-55be-4cb4-ac07-fd8187273285 req-fd6c7d3e-141a-410a-97be-c1577d72d980 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:32 user nova-compute[75020]: DEBUG nova.compute.manager [req-9a78bb03-55be-4cb4-ac07-fd8187273285 req-fd6c7d3e-141a-410a-97be-c1577d72d980 service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-unplugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:06:33 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Instance destroyed successfully.
Nov 30 11:06:33 user nova-compute[75020]: DEBUG nova.objects.instance [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'resources' on Instance uuid 9768f14b-9e34-421e-be7c-e541442814e4 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-533945810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-533945810',id=13,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-po0avutn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:54:32Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=9768f14b-9e34-421e-be7c-e541442814e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "address": "fa:16:3e:83:8a:24", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d72d13-bb", "ovs_interfaceid": "e6d72d13-bbe8-4450-ab51-a898223e1ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:8a:24,bridge_name='br-int',has_traffic_filtering=True,id=e6d72d13-bbe8-4450-ab51-a898223e1ca2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d72d13-bb') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_vif [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:8a:24,bridge_name='br-int',has_traffic_filtering=True,id=e6d72d13-bbe8-4450-ab51-a898223e1ca2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d72d13-bb') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6d72d13-bb, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efc5540f-30ce-4fa4-807c-42e4ead57bdf) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:33 user nova-compute[75020]: INFO os_vif [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:8a:24,bridge_name='br-int',has_traffic_filtering=True,id=e6d72d13-bbe8-4450-ab51-a898223e1ca2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d72d13-bb')
Nov 30 11:06:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqvIyoft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:06:33 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[14125d80-6b16-49f6-8bf0-8627fbf96e77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:06:33 user nova-compute[75020]: No targets found.
Nov 30 11:06:33 user nova-compute[75020]: iSNS:
Nov 30 11:06:33 user nova-compute[75020]: No targets found.
Nov 30 11:06:33 user nova-compute[75020]: STATIC:
Nov 30 11:06:33 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9
Nov 30 11:06:33 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:06:33 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:06:33 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482
Nov 30 11:06:33 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:06:33 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:06:33 user nova-compute[75020]: FIRMWARE:
Nov 30 11:06:33 user nova-compute[75020]: No targets found.
Nov 30 11:06:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:06:33 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:06:33 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce33c2a4-2a9b-45a6-b816-ee9e1600ccfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa0268-6ef2-4767-9fe0-b06aa1ec5932]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:06:33 user nova-compute[75020]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:06:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 (non-flash)
Nov 30 11:06:33 user nova-compute[75020]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:06:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad886943a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca489f70-519c-4f06-8e91-0076bf8ad925]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[17907c03-7896-43fa-9c5f-92fb040a508a]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[813bfe82-1340-4205-a82f-89799efaf75c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d92c25a-8e31-4b59-8756-fbc9a9bebd84]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1c8bbe-ba4d-4b86-ae16-331fc2514057]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c514f0b-c97f-4c8a-93d9-be5fbc13668b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482, portal: 172.16.0.220,3260]
Nov 30 11:06:33 user nova-compute[75020]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482, portal: 172.16.0.220,3260] successful.
Nov 30 11:06:33 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42207515-31c1-47d2-8265-2c940db06482 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f59b3bd-428c-4188-8490-de87c867e9ec]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] <== disconnect_volume: return (307ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:06:33 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Deleting instance files /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4_del
Nov 30 11:06:33 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Deletion of /opt/stack/data/nova/instances/9768f14b-9e34-421e-be7c-e541442814e4_del complete
Nov 30 11:06:33 user nova-compute[75020]: INFO nova.compute.manager [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 30 11:06:33 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:06:33 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:06:34 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:34 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Took 0.75 seconds to deallocate network for instance.
Nov 30 11:06:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-8d62ddd6-876b-4b59-a71e-b09e1eea92fd req-b01dd5a4-7a0c-43ab-ac0c-0f66f2ded01f service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-deleted-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:34 user nova-compute[75020]: INFO nova.compute.manager [req-8d62ddd6-876b-4b59-a71e-b09e1eea92fd req-b01dd5a4-7a0c-43ab-ac0c-0f66f2ded01f service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Neutron deleted interface e6d72d13-bbe8-4450-ab51-a898223e1ca2; detaching it from the instance and deleting it from the info cache
Nov 30 11:06:34 user nova-compute[75020]: DEBUG nova.network.neutron [req-8d62ddd6-876b-4b59-a71e-b09e1eea92fd req-b01dd5a4-7a0c-43ab-ac0c-0f66f2ded01f service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-8d62ddd6-876b-4b59-a71e-b09e1eea92fd req-b01dd5a4-7a0c-43ab-ac0c-0f66f2ded01f service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Detach interface failed, port_id=e6d72d13-bbe8-4450-ab51-a898223e1ca2, reason: Instance 9768f14b-9e34-421e-be7c-e541442814e4 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 11:06:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-83c7ca24-fd79-40ec-ad02-2c2c35467a71 req-c1379fcd-da78-4c91-adba-f80add4c423e service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-83c7ca24-fd79-40ec-ad02-2c2c35467a71 req-c1379fcd-da78-4c91-adba-f80add4c423e service nova] Acquiring lock "9768f14b-9e34-421e-be7c-e541442814e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-83c7ca24-fd79-40ec-ad02-2c2c35467a71 req-c1379fcd-da78-4c91-adba-f80add4c423e service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-83c7ca24-fd79-40ec-ad02-2c2c35467a71 req-c1379fcd-da78-4c91-adba-f80add4c423e service nova] Lock "9768f14b-9e34-421e-be7c-e541442814e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-83c7ca24-fd79-40ec-ad02-2c2c35467a71 req-c1379fcd-da78-4c91-adba-f80add4c423e service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] No waiting events found dispatching network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:34 user nova-compute[75020]: WARNING nova.compute.manager [req-83c7ca24-fd79-40ec-ad02-2c2c35467a71 req-c1379fcd-da78-4c91-adba-f80add4c423e service nova] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Received unexpected event network-vif-plugged-e6d72d13-bbe8-4450-ab51-a898223e1ca2 for instance with vm_state active and task_state deleting.
Nov 30 11:06:36 user nova-compute[75020]: INFO nova.compute.manager [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: 9768f14b-9e34-421e-be7c-e541442814e4] Took 1.81 seconds to detach 1 volumes for instance.
Nov 30 11:06:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:36 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:06:36 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:06:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:36 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Deleted allocations for instance 9768f14b-9e34-421e-be7c-e541442814e4
Nov 30 11:06:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-10516b90-a015-4bf6-bf21-69a8a179a8e5 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "9768f14b-9e34-421e-be7c-e541442814e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.214s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:06:38 user nova-compute[75020]: INFO nova.compute.claims [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Claim successful on node user
Nov 30 11:06:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:06:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.policy [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19afae8899f440c78b8a442361d5b531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c52e77c7064c97bc18c9df58ae20ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:06:38 user nova-compute[75020]: INFO nova.virt.block_device [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Booting with volume 02160fe3-2891-461b-85c9-8a92451ef62e at /dev/vda
Nov 30 11:06:38 user nova-compute[75020]: DEBUG os_brick.utils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28682d0-20ac-4808-9fff-aa6d8d5958c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa601c0f-0762-497a-be34-86e464efc67f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eacfc9-5292-4971-827b-642a59a8d82b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af15b6-d142-4b62-8e14-4140192da96b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:06:38 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:06:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f060dd67-c294-446a-90f1-6ddcb1d0e708]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG os_brick.utils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:06:38 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Updating existing volume attachment record: 21e089f6-949e-485f-a75a-5904abbc07fa {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:06:39 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Successfully created port: e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Successfully updated port: e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquired lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-b2f13363-2adf-44d9-93d2-83974069b458 req-a8775762-7a79-40ce-9d43-4d4760f1ac81 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received event network-changed-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-b2f13363-2adf-44d9-93d2-83974069b458 req-a8775762-7a79-40ce-9d43-4d4760f1ac81 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Refreshing instance network info cache due to event network-changed-e231c110-67d6-4736-994d-2c2b54881991. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b2f13363-2adf-44d9-93d2-83974069b458 req-a8775762-7a79-40ce-9d43-4d4760f1ac81 service nova] Acquiring lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Updating instance_info_cache with network_info: [{"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Releasing lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Instance network_info: |[{"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b2f13363-2adf-44d9-93d2-83974069b458 req-a8775762-7a79-40ce-9d43-4d4760f1ac81 service nova] Acquired lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:06:40 user nova-compute[75020]: DEBUG nova.network.neutron [req-b2f13363-2adf-44d9-93d2-83974069b458 req-a8775762-7a79-40ce-9d43-4d4760f1ac81 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Refreshing network info cache for port e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:06:41 user nova-compute[75020]: DEBUG nova.network.neutron [req-b2f13363-2adf-44d9-93d2-83974069b458 req-a8775762-7a79-40ce-9d43-4d4760f1ac81 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Updated VIF entry in instance network info cache for port e231c110-67d6-4736-994d-2c2b54881991. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:06:41 user nova-compute[75020]: DEBUG nova.network.neutron [req-b2f13363-2adf-44d9-93d2-83974069b458 req-a8775762-7a79-40ce-9d43-4d4760f1ac81 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Updating instance_info_cache with network_info: [{"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b2f13363-2adf-44d9-93d2-83974069b458 req-a8775762-7a79-40ce-9d43-4d4760f1ac81 service nova] Releasing lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:06:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:06:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Creating image(s)
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Ensure instance console log exists: /opt/stack/data/nova/instances/67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Start _get_guest_xml network_info=[{"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '21e089f6-949e-485f-a75a-5904abbc07fa', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZItoOes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb', 'attached_at': '', 'detached_at': '', 'volume_id': '02160fe3-2891-461b-85c9-8a92451ef62e', 'serial': '02160fe3-2891-461b-85c9-8a92451ef62e'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:06:47 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:06:47 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZItoOes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:06:47 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:06:47 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:06:47 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e64996-5dc9-4354-bb7d-5bc882cae346]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:06:47 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6993634f-11bd-498c-affe-1c885ec0da40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e] added
Nov 30 11:06:47 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[308c8fe4-835e-4f3b-98ff-f2b01aae340f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[745bb738-134a-40b2-9ceb-196504c6b4bc]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZItoOes {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZItoOes" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a4ad52-6942-4042-9d37-ee56d8145b5e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZItoOes'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a28adc0-948b-4700-ab25-aa4535a4e78a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77ea557-b708-4fd2-ad78-4245e640ab6f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:06:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:06:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd8f288-dcec-44be-b46f-30dcc37d7ec4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260]
Nov 30 11:06:48 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260] successful.
Nov 30 11:06:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9dd76f-5170-49c6-93e2-b6ea6a134bfa]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29ce64e-3f6a-457d-8e36-e2de98c73780]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:06:48 user nova-compute[75020]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:06:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:06:48 user nova-compute[75020]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:06:48 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7805722-c391-4aa3-8901-3357752529c7]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:06:48 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZItoOes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26638643230663533', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638643230663533', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1889575090',display_name='tempest-TestVolumeBootPattern-server-1889575090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1889575090',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-dmrh0su8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:06:38Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:a5:a4,bridge_name='br-int',has_traffic_filtering=True,id=e231c110-67d6-4736-994d-2c2b54881991,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape231c110-67') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'pci_devices' on Instance uuid 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:06:49 user nova-compute[75020]:   <uuid>67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb</uuid>
Nov 30 11:06:49 user nova-compute[75020]:   <name>instance-00000023</name>
Nov 30 11:06:49 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:06:49 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:06:49 user nova-compute[75020]:   <metadata>
Nov 30 11:06:49 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:06:49 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:06:49 user nova-compute[75020]:       <nova:name>tempest-TestVolumeBootPattern-server-1889575090</nova:name>
Nov 30 11:06:49 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:06:47</nova:creationTime>
Nov 30 11:06:49 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:06:49 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:06:49 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:06:49 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:06:49 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:06:49 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:06:49 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:06:49 user nova-compute[75020]:       <nova:owner>
Nov 30 11:06:49 user nova-compute[75020]:         <nova:user uuid="19afae8899f440c78b8a442361d5b531">tempest-TestVolumeBootPattern-1120216767-project-member</nova:user>
Nov 30 11:06:49 user nova-compute[75020]:         <nova:project uuid="54c52e77c7064c97bc18c9df58ae20ef">tempest-TestVolumeBootPattern-1120216767</nova:project>
Nov 30 11:06:49 user nova-compute[75020]:       </nova:owner>
Nov 30 11:06:49 user nova-compute[75020]:       <nova:ports>
Nov 30 11:06:49 user nova-compute[75020]:         <nova:port uuid="e231c110-67d6-4736-994d-2c2b54881991">
Nov 30 11:06:49 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 11:06:49 user nova-compute[75020]:         </nova:port>
Nov 30 11:06:49 user nova-compute[75020]:       </nova:ports>
Nov 30 11:06:49 user nova-compute[75020]:     </nova:instance>
Nov 30 11:06:49 user nova-compute[75020]:   </metadata>
Nov 30 11:06:49 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:06:49 user nova-compute[75020]:     <system>
Nov 30 11:06:49 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:06:49 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:06:49 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:06:49 user nova-compute[75020]:       <entry name="serial">67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb</entry>
Nov 30 11:06:49 user nova-compute[75020]:       <entry name="uuid">67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb</entry>
Nov 30 11:06:49 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:06:49 user nova-compute[75020]:     </system>
Nov 30 11:06:49 user nova-compute[75020]:   </sysinfo>
Nov 30 11:06:49 user nova-compute[75020]:   <os>
Nov 30 11:06:49 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:06:49 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:06:49 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:06:49 user nova-compute[75020]:   </os>
Nov 30 11:06:49 user nova-compute[75020]:   <features>
Nov 30 11:06:49 user nova-compute[75020]:     <acpi/>
Nov 30 11:06:49 user nova-compute[75020]:     <apic/>
Nov 30 11:06:49 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:06:49 user nova-compute[75020]:   </features>
Nov 30 11:06:49 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:06:49 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:06:49 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:06:49 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:06:49 user nova-compute[75020]:   </clock>
Nov 30 11:06:49 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:06:49 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:06:49 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:06:49 user nova-compute[75020]:   </cpu>
Nov 30 11:06:49 user nova-compute[75020]:   <devices>
Nov 30 11:06:49 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:06:49 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:06:49 user nova-compute[75020]:       <source dev="/dev/sdb"/>
Nov 30 11:06:49 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:06:49 user nova-compute[75020]:       <serial>02160fe3-2891-461b-85c9-8a92451ef62e</serial>
Nov 30 11:06:49 user nova-compute[75020]:     </disk>
Nov 30 11:06:49 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:06:49 user nova-compute[75020]:       <mac address="fa:16:3e:23:a5:a4"/>
Nov 30 11:06:49 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:06:49 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:06:49 user nova-compute[75020]:       <target dev="tape231c110-67"/>
Nov 30 11:06:49 user nova-compute[75020]:     </interface>
Nov 30 11:06:49 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:06:49 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb/console.log" append="off"/>
Nov 30 11:06:49 user nova-compute[75020]:     </serial>
Nov 30 11:06:49 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:06:49 user nova-compute[75020]:     <video>
Nov 30 11:06:49 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:06:49 user nova-compute[75020]:     </video>
Nov 30 11:06:49 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:06:49 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:06:49 user nova-compute[75020]:     </rng>
Nov 30 11:06:49 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:06:49 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:06:49 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:06:49 user nova-compute[75020]:     </memballoon>
Nov 30 11:06:49 user nova-compute[75020]:   </devices>
Nov 30 11:06:49 user nova-compute[75020]: </domain>
Nov 30 11:06:49 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1889575090',display_name='tempest-TestVolumeBootPattern-server-1889575090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1889575090',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-dmrh0su8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:06:38Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:a5:a4,bridge_name='br-int',has_traffic_filtering=True,id=e231c110-67d6-4736-994d-2c2b54881991,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape231c110-67') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG os_vif [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:a5:a4,bridge_name='br-int',has_traffic_filtering=True,id=e231c110-67d6-4736-994d-2c2b54881991,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape231c110-67') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11ebdb89-915a-5f4d-a973-a285398312cf', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape231c110-67, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape231c110-67, col_values=(('qos', UUID('eb303e0f-a4af-45b4-a4d3-dde0ca2d9c6e')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape231c110-67, col_values=(('external_ids', {'iface-id': 'e231c110-67d6-4736-994d-2c2b54881991', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:a5:a4', 'vm-uuid': '67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:49 user nova-compute[75020]: INFO os_vif [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:a5:a4,bridge_name='br-int',has_traffic_filtering=True,id=e231c110-67d6-4736-994d-2c2b54881991,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape231c110-67')
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:06:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No VIF found with MAC fa:16:3e:23:a5:a4, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:06:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-8e686bc2-d81d-4de9-8f7c-97c236ec1425 req-9f9f1687-8923-48a4-8bc7-ffc7b2811466 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received event network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8e686bc2-d81d-4de9-8f7c-97c236ec1425 req-9f9f1687-8923-48a4-8bc7-ffc7b2811466 service nova] Acquiring lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8e686bc2-d81d-4de9-8f7c-97c236ec1425 req-9f9f1687-8923-48a4-8bc7-ffc7b2811466 service nova] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8e686bc2-d81d-4de9-8f7c-97c236ec1425 req-9f9f1687-8923-48a4-8bc7-ffc7b2811466 service nova] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-8e686bc2-d81d-4de9-8f7c-97c236ec1425 req-9f9f1687-8923-48a4-8bc7-ffc7b2811466 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] No waiting events found dispatching network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:51 user nova-compute[75020]: WARNING nova.compute.manager [req-8e686bc2-d81d-4de9-8f7c-97c236ec1425 req-9f9f1687-8923-48a4-8bc7-ffc7b2811466 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received unexpected event network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 for instance with vm_state building and task_state spawning.
Nov 30 11:06:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:51 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:06:51 user nova-compute[75020]: INFO nova.compute.claims [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Claim successful on node user
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:06:52 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.policy [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007c1fe9701d4950a6f3e69faea04afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0273db32a544b7861db7e9c230b963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:06:52 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Creating image(s)
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "/opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "/opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "/opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:06:52 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Instance spawned successfully.
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.207s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk 1073741824" returned: 0 in 0.072s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:53 user nova-compute[75020]: INFO nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 30 11:06:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Successfully created port: bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.230s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:53 user nova-compute[75020]: INFO nova.compute.manager [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Took 15.20 seconds to build instance.
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bf46b373-f27a-4f99-8e27-302702c8e475 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.304s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Cannot resize image /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Ensure instance console log exists: /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-14c39b94-bff7-43aa-b2df-c28408437e2a req-b148a364-f3c7-4deb-8aa8-56f76b3e8eea service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received event network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14c39b94-bff7-43aa-b2df-c28408437e2a req-b148a364-f3c7-4deb-8aa8-56f76b3e8eea service nova] Acquiring lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14c39b94-bff7-43aa-b2df-c28408437e2a req-b148a364-f3c7-4deb-8aa8-56f76b3e8eea service nova] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14c39b94-bff7-43aa-b2df-c28408437e2a req-b148a364-f3c7-4deb-8aa8-56f76b3e8eea service nova] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-14c39b94-bff7-43aa-b2df-c28408437e2a req-b148a364-f3c7-4deb-8aa8-56f76b3e8eea service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] No waiting events found dispatching network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:53 user nova-compute[75020]: WARNING nova.compute.manager [req-14c39b94-bff7-43aa-b2df-c28408437e2a req-b148a364-f3c7-4deb-8aa8-56f76b3e8eea service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received unexpected event network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 for instance with vm_state active and task_state None.
Nov 30 11:06:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Skipping network cache update for instance because it is Building. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid d88214a8-f7f1-4735-8faf-611d70a77d9f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Successfully updated port: bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "refresh_cache-64faec4f-7e2b-40cd-b061-bea6da2e18d3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquired lock "refresh_cache-64faec4f-7e2b-40cd-b061-bea6da2e18d3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-539095e0-f4d9-407a-9eb0-e2dcefc8386c req-2a3fadeb-3bda-42e3-ae56-c5f3ec3b6c80 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received event network-changed-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-539095e0-f4d9-407a-9eb0-e2dcefc8386c req-2a3fadeb-3bda-42e3-ae56-c5f3ec3b6c80 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Refreshing instance network info cache due to event network-changed-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-539095e0-f4d9-407a-9eb0-e2dcefc8386c req-2a3fadeb-3bda-42e3-ae56-c5f3ec3b6c80 service nova] Acquiring lock "refresh_cache-64faec4f-7e2b-40cd-b061-bea6da2e18d3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Updating instance_info_cache with network_info: [{"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Releasing lock "refresh_cache-64faec4f-7e2b-40cd-b061-bea6da2e18d3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Instance network_info: |[{"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-539095e0-f4d9-407a-9eb0-e2dcefc8386c req-2a3fadeb-3bda-42e3-ae56-c5f3ec3b6c80 service nova] Acquired lock "refresh_cache-64faec4f-7e2b-40cd-b061-bea6da2e18d3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.neutron [req-539095e0-f4d9-407a-9eb0-e2dcefc8386c req-2a3fadeb-3bda-42e3-ae56-c5f3ec3b6c80 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Refreshing network info cache for port bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Start _get_guest_xml network_info=[{"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:06:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:06:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-617813740',display_name='tempest-VolumesActionsTest-instance-617813740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-617813740',id=36,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef0273db32a544b7861db7e9c230b963',ramdisk_id='',reservation_id='r-sz0v2jn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1089300411',owner_user_name='tempest-VolumesActionsTest-1089300411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:06:52Z,user_data=None,user_id='007c1fe9701d4950a6f3e69faea04afc',uuid=64faec4f-7e2b-40cd-b061-bea6da2e18d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converting VIF {"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=bf13bb7d-495c-45d8-a8d6-b0d13c6cdade,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf13bb7d-49') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lazy-loading 'pci_devices' on Instance uuid 64faec4f-7e2b-40cd-b061-bea6da2e18d3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:06:54 user nova-compute[75020]:   <uuid>64faec4f-7e2b-40cd-b061-bea6da2e18d3</uuid>
Nov 30 11:06:54 user nova-compute[75020]:   <name>instance-00000024</name>
Nov 30 11:06:54 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:06:54 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:06:54 user nova-compute[75020]:   <metadata>
Nov 30 11:06:54 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:06:54 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:06:54 user nova-compute[75020]:       <nova:name>tempest-VolumesActionsTest-instance-617813740</nova:name>
Nov 30 11:06:54 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:06:54</nova:creationTime>
Nov 30 11:06:54 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:06:54 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:06:54 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:06:54 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:06:54 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:06:54 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:06:54 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:06:54 user nova-compute[75020]:       <nova:owner>
Nov 30 11:06:54 user nova-compute[75020]:         <nova:user uuid="007c1fe9701d4950a6f3e69faea04afc">tempest-VolumesActionsTest-1089300411-project-member</nova:user>
Nov 30 11:06:54 user nova-compute[75020]:         <nova:project uuid="ef0273db32a544b7861db7e9c230b963">tempest-VolumesActionsTest-1089300411</nova:project>
Nov 30 11:06:54 user nova-compute[75020]:       </nova:owner>
Nov 30 11:06:54 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:06:54 user nova-compute[75020]:       <nova:ports>
Nov 30 11:06:54 user nova-compute[75020]:         <nova:port uuid="bf13bb7d-495c-45d8-a8d6-b0d13c6cdade">
Nov 30 11:06:54 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 11:06:54 user nova-compute[75020]:         </nova:port>
Nov 30 11:06:54 user nova-compute[75020]:       </nova:ports>
Nov 30 11:06:54 user nova-compute[75020]:     </nova:instance>
Nov 30 11:06:54 user nova-compute[75020]:   </metadata>
Nov 30 11:06:54 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:06:54 user nova-compute[75020]:     <system>
Nov 30 11:06:54 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:06:54 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:06:54 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:06:54 user nova-compute[75020]:       <entry name="serial">64faec4f-7e2b-40cd-b061-bea6da2e18d3</entry>
Nov 30 11:06:54 user nova-compute[75020]:       <entry name="uuid">64faec4f-7e2b-40cd-b061-bea6da2e18d3</entry>
Nov 30 11:06:54 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:06:54 user nova-compute[75020]:     </system>
Nov 30 11:06:54 user nova-compute[75020]:   </sysinfo>
Nov 30 11:06:54 user nova-compute[75020]:   <os>
Nov 30 11:06:54 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:06:54 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:06:54 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:06:54 user nova-compute[75020]:   </os>
Nov 30 11:06:54 user nova-compute[75020]:   <features>
Nov 30 11:06:54 user nova-compute[75020]:     <acpi/>
Nov 30 11:06:54 user nova-compute[75020]:     <apic/>
Nov 30 11:06:54 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:06:54 user nova-compute[75020]:   </features>
Nov 30 11:06:54 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:06:54 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:06:54 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:06:54 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:06:54 user nova-compute[75020]:   </clock>
Nov 30 11:06:54 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:06:54 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:06:54 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:06:54 user nova-compute[75020]:   </cpu>
Nov 30 11:06:54 user nova-compute[75020]:   <devices>
Nov 30 11:06:54 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:06:54 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:06:54 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk"/>
Nov 30 11:06:54 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:06:54 user nova-compute[75020]:     </disk>
Nov 30 11:06:54 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:06:54 user nova-compute[75020]:       <mac address="fa:16:3e:b7:bb:c4"/>
Nov 30 11:06:54 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:06:54 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:06:54 user nova-compute[75020]:       <target dev="tapbf13bb7d-49"/>
Nov 30 11:06:54 user nova-compute[75020]:     </interface>
Nov 30 11:06:54 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:06:54 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/console.log" append="off"/>
Nov 30 11:06:54 user nova-compute[75020]:     </serial>
Nov 30 11:06:54 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:06:54 user nova-compute[75020]:     <video>
Nov 30 11:06:54 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:06:54 user nova-compute[75020]:     </video>
Nov 30 11:06:54 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:06:54 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:06:54 user nova-compute[75020]:     </rng>
Nov 30 11:06:54 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:06:54 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:06:54 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:06:54 user nova-compute[75020]:     </memballoon>
Nov 30 11:06:54 user nova-compute[75020]:   </devices>
Nov 30 11:06:54 user nova-compute[75020]: </domain>
Nov 30 11:06:54 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-617813740',display_name='tempest-VolumesActionsTest-instance-617813740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-617813740',id=36,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef0273db32a544b7861db7e9c230b963',ramdisk_id='',reservation_id='r-sz0v2jn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1089300411',owner_user_name='tempest-VolumesActionsTest-1089300411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:06:52Z,user_data=None,user_id='007c1fe9701d4950a6f3e69faea04afc',uuid=64faec4f-7e2b-40cd-b061-bea6da2e18d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converting VIF {"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=bf13bb7d-495c-45d8-a8d6-b0d13c6cdade,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf13bb7d-49') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG os_vif [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=bf13bb7d-495c-45d8-a8d6-b0d13c6cdade,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf13bb7d-49') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updating instance_info_cache with network_info: [{"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '371d15f6-1a07-5ff4-a0b4-f986deaa5f98', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-d88214a8-f7f1-4735-8faf-611d70a77d9f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf13bb7d-49, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf13bb7d-49, col_values=(('qos', UUID('b36b32a3-9fca-473d-b4d5-7263ad0cce11')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf13bb7d-49, col_values=(('external_ids', {'iface-id': 'bf13bb7d-495c-45d8-a8d6-b0d13c6cdade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:bb:c4', 'vm-uuid': '64faec4f-7e2b-40cd-b061-bea6da2e18d3'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:54 user nova-compute[75020]: INFO os_vif [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=bf13bb7d-495c-45d8-a8d6-b0d13c6cdade,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf13bb7d-49')
Nov 30 11:06:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:06:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] No VIF found with MAC fa:16:3e:b7:bb:c4, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:06:55 user nova-compute[75020]: DEBUG nova.network.neutron [req-539095e0-f4d9-407a-9eb0-e2dcefc8386c req-2a3fadeb-3bda-42e3-ae56-c5f3ec3b6c80 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Updated VIF entry in instance network info cache for port bf13bb7d-495c-45d8-a8d6-b0d13c6cdade. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:06:55 user nova-compute[75020]: DEBUG nova.network.neutron [req-539095e0-f4d9-407a-9eb0-e2dcefc8386c req-2a3fadeb-3bda-42e3-ae56-c5f3ec3b6c80 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Updating instance_info_cache with network_info: [{"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-539095e0-f4d9-407a-9eb0-e2dcefc8386c req-2a3fadeb-3bda-42e3-ae56-c5f3ec3b6c80 service nova] Releasing lock "refresh_cache-64faec4f-7e2b-40cd-b061-bea6da2e18d3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-61bed574-8762-4228-9899-7205654cddf0 req-c3807939-9164-4696-b221-6926d4dcac21 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received event network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-61bed574-8762-4228-9899-7205654cddf0 req-c3807939-9164-4696-b221-6926d4dcac21 service nova] Acquiring lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-61bed574-8762-4228-9899-7205654cddf0 req-c3807939-9164-4696-b221-6926d4dcac21 service nova] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-61bed574-8762-4228-9899-7205654cddf0 req-c3807939-9164-4696-b221-6926d4dcac21 service nova] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-61bed574-8762-4228-9899-7205654cddf0 req-c3807939-9164-4696-b221-6926d4dcac21 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] No waiting events found dispatching network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:56 user nova-compute[75020]: WARNING nova.compute.manager [req-61bed574-8762-4228-9899-7205654cddf0 req-c3807939-9164-4696-b221-6926d4dcac21 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received unexpected event network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade for instance with vm_state building and task_state spawning.
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:56 user nova-compute[75020]: INFO nova.compute.manager [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Terminating instance
Nov 30 11:06:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf3736ca-16a6-404d-896a-f34df756dd3c req-316ca87a-4d54-41e3-9e28-299420a0376e service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-vif-unplugged-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf3736ca-16a6-404d-896a-f34df756dd3c req-316ca87a-4d54-41e3-9e28-299420a0376e service nova] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf3736ca-16a6-404d-896a-f34df756dd3c req-316ca87a-4d54-41e3-9e28-299420a0376e service nova] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf3736ca-16a6-404d-896a-f34df756dd3c req-316ca87a-4d54-41e3-9e28-299420a0376e service nova] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf3736ca-16a6-404d-896a-f34df756dd3c req-316ca87a-4d54-41e3-9e28-299420a0376e service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] No waiting events found dispatching network-vif-unplugged-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf3736ca-16a6-404d-896a-f34df756dd3c req-316ca87a-4d54-41e3-9e28-299420a0376e service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-vif-unplugged-a3626203-1d0f-4d96-bf21-796358c11fd2 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Instance destroyed successfully.
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.objects.instance [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lazy-loading 'resources' on Instance uuid 1c7e9069-f20d-4389-bbe9-5b3702d408e5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-75449479',display_name='tempest-ServerActionsTestOtherA-server-75449479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-75449479',id=4,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHTb0SOWTaJyZAue2gXr9c0UzhTsWONY94RcIaASS6V9txpzCo6WC5DK7WbAEL0uT8sOPkz/0PBlI9va80ow5F9NSBzIiCxYC4rzLVKDLAdQsr800DKacHrZDs3sUGsVA==',key_name='tempest-keypair-2028818104',keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10919b523b740859f3ac98e31468a93',ramdisk_id='',reservation_id='r-egyu61be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-582760806',owner_user_name='tempest-ServerActionsTestOtherA-582760806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:48:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f64ef255b2a48349a280bf3693af23f',uuid=1c7e9069-f20d-4389-bbe9-5b3702d408e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converting VIF {"id": "a3626203-1d0f-4d96-bf21-796358c11fd2", "address": "fa:16:3e:75:bf:67", "network": {"id": "e8d588c2-5a73-4f01-ad4d-5abc8e145888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-830753088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10919b523b740859f3ac98e31468a93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3626203-1d", "ovs_interfaceid": "a3626203-1d0f-4d96-bf21-796358c11fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=a3626203-1d0f-4d96-bf21-796358c11fd2,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3626203-1d') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG os_vif [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=a3626203-1d0f-4d96-bf21-796358c11fd2,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3626203-1d') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3626203-1d, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=160cc0a1-66ca-4be4-8791-dc8e7b321334) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:06:57 user nova-compute[75020]: INFO os_vif [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=a3626203-1d0f-4d96-bf21-796358c11fd2,network=Network(e8d588c2-5a73-4f01-ad4d-5abc8e145888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3626203-1d')
Nov 30 11:06:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Deleting instance files /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5_del
Nov 30 11:06:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Deletion of /opt/stack/data/nova/instances/1c7e9069-f20d-4389-bbe9-5b3702d408e5_del complete
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:57 user nova-compute[75020]: INFO nova.compute.manager [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:06:58 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Took 0.59 seconds to deallocate network for instance.
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:58 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid '1c7e9069-f20d-4389-bbe9-5b3702d408e5' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid '1c7e9069-f20d-4389-bbe9-5b3702d408e5' (instance-00000004)
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-6095b86b-db9e-4b71-83a3-d0d17a4aee4d req-2738462b-4ef9-410a-b981-2beb0614abfc service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received event network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6095b86b-db9e-4b71-83a3-d0d17a4aee4d req-2738462b-4ef9-410a-b981-2beb0614abfc service nova] Acquiring lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6095b86b-db9e-4b71-83a3-d0d17a4aee4d req-2738462b-4ef9-410a-b981-2beb0614abfc service nova] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6095b86b-db9e-4b71-83a3-d0d17a4aee4d req-2738462b-4ef9-410a-b981-2beb0614abfc service nova] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-6095b86b-db9e-4b71-83a3-d0d17a4aee4d req-2738462b-4ef9-410a-b981-2beb0614abfc service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] No waiting events found dispatching network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:58 user nova-compute[75020]: WARNING nova.compute.manager [req-6095b86b-db9e-4b71-83a3-d0d17a4aee4d req-2738462b-4ef9-410a-b981-2beb0614abfc service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received unexpected event network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade for instance with vm_state building and task_state spawning.
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:06:58 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Instance spawned successfully.
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:06:58 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Deleted allocations for instance 1c7e9069-f20d-4389-bbe9-5b3702d408e5
Nov 30 11:06:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-690c6601-779e-402f-836e-983beb0cde47 tempest-ServerActionsTestOtherA-582760806 tempest-ServerActionsTestOtherA-582760806-project-member] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.113s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:59 user nova-compute[75020]: INFO nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 30 11:06:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:06:59 user nova-compute[75020]: INFO nova.compute.manager [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Took 7.44 seconds to build instance.
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2ace74c6-a389-4e3d-8179-1527570a9f4e tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.542s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-962f6cd3-1ce0-4a54-97c3-f717413fec47 req-c6305fce-4ac0-41fa-b00d-8e2434c35592 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-962f6cd3-1ce0-4a54-97c3-f717413fec47 req-c6305fce-4ac0-41fa-b00d-8e2434c35592 service nova] Acquiring lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-962f6cd3-1ce0-4a54-97c3-f717413fec47 req-c6305fce-4ac0-41fa-b00d-8e2434c35592 service nova] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-962f6cd3-1ce0-4a54-97c3-f717413fec47 req-c6305fce-4ac0-41fa-b00d-8e2434c35592 service nova] Lock "1c7e9069-f20d-4389-bbe9-5b3702d408e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-962f6cd3-1ce0-4a54-97c3-f717413fec47 req-c6305fce-4ac0-41fa-b00d-8e2434c35592 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] No waiting events found dispatching network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:06:59 user nova-compute[75020]: WARNING nova.compute.manager [req-962f6cd3-1ce0-4a54-97c3-f717413fec47 req-c6305fce-4ac0-41fa-b00d-8e2434c35592 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received unexpected event network-vif-plugged-a3626203-1d0f-4d96-bf21-796358c11fd2 for instance with vm_state deleted and task_state None.
Nov 30 11:06:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-962f6cd3-1ce0-4a54-97c3-f717413fec47 req-c6305fce-4ac0-41fa-b00d-8e2434c35592 service nova] [instance: 1c7e9069-f20d-4389-bbe9-5b3702d408e5] Received event network-vif-deleted-a3626203-1d0f-4d96-bf21-796358c11fd2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:06:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:07:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8355MB free_disk=25.080692291259766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d88214a8-f7f1-4735-8faf-611d70a77d9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 64faec4f-7e2b-40cd-b061-bea6da2e18d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:07:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:02 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:07:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:07:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:07:19 user nova-compute[75020]: INFO nova.compute.claims [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Claim successful on node user
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:07:20 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:07:20 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Creating image(s)
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "/opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "/opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.policy [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0478b31803ad4dc6bd3b685958845c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd080614cc9e49ffa242d4a771a56ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk 1073741824" returned: 0 in 0.048s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:07:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Successfully created port: ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Cannot resize image /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Ensure instance console log exists: /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Successfully updated port: ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "refresh_cache-1bba3d30-a9d1-4715-bb7b-ed4674da2528" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquired lock "refresh_cache-1bba3d30-a9d1-4715-bb7b-ed4674da2528" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-94fde44a-c90d-44c2-97b9-6e8734ad2403 req-d683675d-603c-47a2-b1f9-e3cf0b1c1246 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received event network-changed-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-94fde44a-c90d-44c2-97b9-6e8734ad2403 req-d683675d-603c-47a2-b1f9-e3cf0b1c1246 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Refreshing instance network info cache due to event network-changed-ee9c5552-4b5b-4573-883f-5a3b91a7802b. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-94fde44a-c90d-44c2-97b9-6e8734ad2403 req-d683675d-603c-47a2-b1f9-e3cf0b1c1246 service nova] Acquiring lock "refresh_cache-1bba3d30-a9d1-4715-bb7b-ed4674da2528" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:07:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Updating instance_info_cache with network_info: [{"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Releasing lock "refresh_cache-1bba3d30-a9d1-4715-bb7b-ed4674da2528" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Instance network_info: |[{"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-94fde44a-c90d-44c2-97b9-6e8734ad2403 req-d683675d-603c-47a2-b1f9-e3cf0b1c1246 service nova] Acquired lock "refresh_cache-1bba3d30-a9d1-4715-bb7b-ed4674da2528" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-94fde44a-c90d-44c2-97b9-6e8734ad2403 req-d683675d-603c-47a2-b1f9-e3cf0b1c1246 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Refreshing network info cache for port ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Start _get_guest_xml network_info=[{"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:07:22 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:07:22 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1913238620',display_name='tempest-VolumesNegativeTest-instance-1913238620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1913238620',id=37,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd080614cc9e49ffa242d4a771a56ba3',ramdisk_id='',reservation_id='r-1lgpthw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1578618755',owner_user_name='tempest-VolumesNegativeTest-1578618755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:07:20Z,user_data=None,user_id='0478b31803ad4dc6bd3b685958845c04',uuid=1bba3d30-a9d1-4715-bb7b-ed4674da2528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Converting VIF {"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee9c5552-4b5b-4573-883f-5a3b91a7802b,network=Network(ac9a6e5a-a22b-403c-ae36-91766f6a8235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9c5552-4b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bba3d30-a9d1-4715-bb7b-ed4674da2528 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:07:22 user nova-compute[75020]:   <uuid>1bba3d30-a9d1-4715-bb7b-ed4674da2528</uuid>
Nov 30 11:07:22 user nova-compute[75020]:   <name>instance-00000025</name>
Nov 30 11:07:22 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:07:22 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:07:22 user nova-compute[75020]:   <metadata>
Nov 30 11:07:22 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:07:22 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:07:22 user nova-compute[75020]:       <nova:name>tempest-VolumesNegativeTest-instance-1913238620</nova:name>
Nov 30 11:07:22 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:07:22</nova:creationTime>
Nov 30 11:07:22 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:07:22 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:07:22 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:07:22 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:07:22 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:07:22 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:07:22 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:07:22 user nova-compute[75020]:       <nova:owner>
Nov 30 11:07:22 user nova-compute[75020]:         <nova:user uuid="0478b31803ad4dc6bd3b685958845c04">tempest-VolumesNegativeTest-1578618755-project-member</nova:user>
Nov 30 11:07:22 user nova-compute[75020]:         <nova:project uuid="dd080614cc9e49ffa242d4a771a56ba3">tempest-VolumesNegativeTest-1578618755</nova:project>
Nov 30 11:07:22 user nova-compute[75020]:       </nova:owner>
Nov 30 11:07:22 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:07:22 user nova-compute[75020]:       <nova:ports>
Nov 30 11:07:22 user nova-compute[75020]:         <nova:port uuid="ee9c5552-4b5b-4573-883f-5a3b91a7802b">
Nov 30 11:07:22 user nova-compute[75020]:           <nova:ip type="fixed" address="192.168.233.77" ipVersion="4"/>
Nov 30 11:07:22 user nova-compute[75020]:         </nova:port>
Nov 30 11:07:22 user nova-compute[75020]:       </nova:ports>
Nov 30 11:07:22 user nova-compute[75020]:     </nova:instance>
Nov 30 11:07:22 user nova-compute[75020]:   </metadata>
Nov 30 11:07:22 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:07:22 user nova-compute[75020]:     <system>
Nov 30 11:07:22 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:07:22 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:07:22 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:07:22 user nova-compute[75020]:       <entry name="serial">1bba3d30-a9d1-4715-bb7b-ed4674da2528</entry>
Nov 30 11:07:22 user nova-compute[75020]:       <entry name="uuid">1bba3d30-a9d1-4715-bb7b-ed4674da2528</entry>
Nov 30 11:07:22 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:07:22 user nova-compute[75020]:     </system>
Nov 30 11:07:22 user nova-compute[75020]:   </sysinfo>
Nov 30 11:07:22 user nova-compute[75020]:   <os>
Nov 30 11:07:22 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:07:22 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:07:22 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:07:22 user nova-compute[75020]:   </os>
Nov 30 11:07:22 user nova-compute[75020]:   <features>
Nov 30 11:07:22 user nova-compute[75020]:     <acpi/>
Nov 30 11:07:22 user nova-compute[75020]:     <apic/>
Nov 30 11:07:22 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:07:22 user nova-compute[75020]:   </features>
Nov 30 11:07:22 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:07:22 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:07:22 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:07:22 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:07:22 user nova-compute[75020]:   </clock>
Nov 30 11:07:22 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:07:22 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:07:22 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:07:22 user nova-compute[75020]:   </cpu>
Nov 30 11:07:22 user nova-compute[75020]:   <devices>
Nov 30 11:07:22 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:07:22 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:07:22 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk"/>
Nov 30 11:07:22 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:07:22 user nova-compute[75020]:     </disk>
Nov 30 11:07:22 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:07:22 user nova-compute[75020]:       <mac address="fa:16:3e:d6:13:a7"/>
Nov 30 11:07:22 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:07:22 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:07:22 user nova-compute[75020]:       <target dev="tapee9c5552-4b"/>
Nov 30 11:07:22 user nova-compute[75020]:     </interface>
Nov 30 11:07:22 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:07:22 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/console.log" append="off"/>
Nov 30 11:07:22 user nova-compute[75020]:     </serial>
Nov 30 11:07:22 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:07:22 user nova-compute[75020]:     <video>
Nov 30 11:07:22 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:07:22 user nova-compute[75020]:     </video>
Nov 30 11:07:22 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:07:22 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:07:22 user nova-compute[75020]:     </rng>
Nov 30 11:07:22 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:07:22 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:07:22 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:07:22 user nova-compute[75020]:     </memballoon>
Nov 30 11:07:22 user nova-compute[75020]:   </devices>
Nov 30 11:07:22 user nova-compute[75020]: </domain>
Nov 30 11:07:22 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1913238620',display_name='tempest-VolumesNegativeTest-instance-1913238620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1913238620',id=37,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd080614cc9e49ffa242d4a771a56ba3',ramdisk_id='',reservation_id='r-1lgpthw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1578618755',owner_user_name='tempest-VolumesNegativeTest-1578618755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:07:20Z,user_data=None,user_id='0478b31803ad4dc6bd3b685958845c04',uuid=1bba3d30-a9d1-4715-bb7b-ed4674da2528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Converting VIF {"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee9c5552-4b5b-4573-883f-5a3b91a7802b,network=Network(ac9a6e5a-a22b-403c-ae36-91766f6a8235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9c5552-4b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG os_vif [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee9c5552-4b5b-4573-883f-5a3b91a7802b,network=Network(ac9a6e5a-a22b-403c-ae36-91766f6a8235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9c5552-4b') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5844bce2-6d19-558e-8eb2-568cf87355b1', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee9c5552-4b, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee9c5552-4b, col_values=(('qos', UUID('e517f7e4-d5f4-4789-9b29-2cc609b560ae')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee9c5552-4b, col_values=(('external_ids', {'iface-id': 'ee9c5552-4b5b-4573-883f-5a3b91a7802b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:13:a7', 'vm-uuid': '1bba3d30-a9d1-4715-bb7b-ed4674da2528'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:22 user nova-compute[75020]: INFO os_vif [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee9c5552-4b5b-4573-883f-5a3b91a7802b,network=Network(ac9a6e5a-a22b-403c-ae36-91766f6a8235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9c5552-4b')
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] No VIF found with MAC fa:16:3e:d6:13:a7, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-94fde44a-c90d-44c2-97b9-6e8734ad2403 req-d683675d-603c-47a2-b1f9-e3cf0b1c1246 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Updated VIF entry in instance network info cache for port ee9c5552-4b5b-4573-883f-5a3b91a7802b. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-94fde44a-c90d-44c2-97b9-6e8734ad2403 req-d683675d-603c-47a2-b1f9-e3cf0b1c1246 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Updating instance_info_cache with network_info: [{"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:07:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-94fde44a-c90d-44c2-97b9-6e8734ad2403 req-d683675d-603c-47a2-b1f9-e3cf0b1c1246 service nova] Releasing lock "refresh_cache-1bba3d30-a9d1-4715-bb7b-ed4674da2528" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:23 user nova-compute[75020]: INFO nova.compute.manager [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Terminating instance
Nov 30 11:07:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-6b8bbfa7-231e-456d-a6cf-68ca34ad1c2f req-b87c7007-32af-404d-b916-dd7155443b2c service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received event network-vif-unplugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6b8bbfa7-231e-456d-a6cf-68ca34ad1c2f req-b87c7007-32af-404d-b916-dd7155443b2c service nova] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6b8bbfa7-231e-456d-a6cf-68ca34ad1c2f req-b87c7007-32af-404d-b916-dd7155443b2c service nova] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6b8bbfa7-231e-456d-a6cf-68ca34ad1c2f req-b87c7007-32af-404d-b916-dd7155443b2c service nova] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-6b8bbfa7-231e-456d-a6cf-68ca34ad1c2f req-b87c7007-32af-404d-b916-dd7155443b2c service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] No waiting events found dispatching network-vif-unplugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-6b8bbfa7-231e-456d-a6cf-68ca34ad1c2f req-b87c7007-32af-404d-b916-dd7155443b2c service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received event network-vif-unplugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-f16c2466-8a2e-4b2a-9731-276fa347b792 req-bb1c7e70-6109-4ca2-8023-38c9dd5b2e95 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received event network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f16c2466-8a2e-4b2a-9731-276fa347b792 req-bb1c7e70-6109-4ca2-8023-38c9dd5b2e95 service nova] Acquiring lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f16c2466-8a2e-4b2a-9731-276fa347b792 req-bb1c7e70-6109-4ca2-8023-38c9dd5b2e95 service nova] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f16c2466-8a2e-4b2a-9731-276fa347b792 req-bb1c7e70-6109-4ca2-8023-38c9dd5b2e95 service nova] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-f16c2466-8a2e-4b2a-9731-276fa347b792 req-bb1c7e70-6109-4ca2-8023-38c9dd5b2e95 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] No waiting events found dispatching network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:07:23 user nova-compute[75020]: WARNING nova.compute.manager [req-f16c2466-8a2e-4b2a-9731-276fa347b792 req-bb1c7e70-6109-4ca2-8023-38c9dd5b2e95 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received unexpected event network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b for instance with vm_state building and task_state spawning.
Nov 30 11:07:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Instance destroyed successfully.
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.objects.instance [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lazy-loading 'resources' on Instance uuid d88214a8-f7f1-4735-8faf-611d70a77d9f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2135448650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2135448650',id=1,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:48:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e02acda28c914dcdaa8afa65411b8055',ramdisk_id='',reservation_id='r-vybt0vmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-548019548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:49:42Z,user_data=None,user_id='a93ae25dec664c44ba88b0f15f6a239e',uuid=d88214a8-f7f1-4735-8faf-611d70a77d9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converting VIF {"id": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "address": "fa:16:3e:87:41:9c", "network": {"id": "4064ebbc-709a-47c7-bc1e-cb2c09fe3682", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1712843303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e02acda28c914dcdaa8afa65411b8055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf756ed97-67", "ovs_interfaceid": "f756ed97-6717-4f69-b7ea-3e503a0d7bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:41:9c,bridge_name='br-int',has_traffic_filtering=True,id=f756ed97-6717-4f69-b7ea-3e503a0d7bf2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf756ed97-67') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG os_vif [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:41:9c,bridge_name='br-int',has_traffic_filtering=True,id=f756ed97-6717-4f69-b7ea-3e503a0d7bf2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf756ed97-67') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf756ed97-67, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f44c9688-56b3-4063-9250-6a1bc2b8a18b) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:07:24 user nova-compute[75020]: INFO os_vif [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:41:9c,bridge_name='br-int',has_traffic_filtering=True,id=f756ed97-6717-4f69-b7ea-3e503a0d7bf2,network=Network(4064ebbc-709a-47c7-bc1e-cb2c09fe3682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf756ed97-67')
Nov 30 11:07:24 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Deleting instance files /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f_del
Nov 30 11:07:24 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Deletion of /opt/stack/data/nova/instances/d88214a8-f7f1-4735-8faf-611d70a77d9f_del complete
Nov 30 11:07:24 user nova-compute[75020]: INFO nova.compute.manager [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 30 11:07:24 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:07:24 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Took 0.40 seconds to deallocate network for instance.
Nov 30 11:07:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:07:24 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:25 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Deleted allocations for instance d88214a8-f7f1-4735-8faf-611d70a77d9f
Nov 30 11:07:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-01c560f2-65a2-4197-985f-9a96f94d6e54 tempest-ServerBootFromVolumeStableRescueTest-548019548 tempest-ServerBootFromVolumeStableRescueTest-548019548-project-member] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.718s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-dc01c864-dda0-4f03-b8a6-b5bbf84fd5e6 req-200b51a1-c3d8-410f-bb40-52a7c035373f service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received event network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc01c864-dda0-4f03-b8a6-b5bbf84fd5e6 req-200b51a1-c3d8-410f-bb40-52a7c035373f service nova] Acquiring lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc01c864-dda0-4f03-b8a6-b5bbf84fd5e6 req-200b51a1-c3d8-410f-bb40-52a7c035373f service nova] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dc01c864-dda0-4f03-b8a6-b5bbf84fd5e6 req-200b51a1-c3d8-410f-bb40-52a7c035373f service nova] Lock "d88214a8-f7f1-4735-8faf-611d70a77d9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-dc01c864-dda0-4f03-b8a6-b5bbf84fd5e6 req-200b51a1-c3d8-410f-bb40-52a7c035373f service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] No waiting events found dispatching network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:07:25 user nova-compute[75020]: WARNING nova.compute.manager [req-dc01c864-dda0-4f03-b8a6-b5bbf84fd5e6 req-200b51a1-c3d8-410f-bb40-52a7c035373f service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received unexpected event network-vif-plugged-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 for instance with vm_state deleted and task_state None.
Nov 30 11:07:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-123a2b0f-4e59-4b5b-9fa5-b9cef6d75c08 req-4106ec89-5e2d-4185-922d-fdd05aa6dbcb service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received event network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-123a2b0f-4e59-4b5b-9fa5-b9cef6d75c08 req-4106ec89-5e2d-4185-922d-fdd05aa6dbcb service nova] Acquiring lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-123a2b0f-4e59-4b5b-9fa5-b9cef6d75c08 req-4106ec89-5e2d-4185-922d-fdd05aa6dbcb service nova] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-123a2b0f-4e59-4b5b-9fa5-b9cef6d75c08 req-4106ec89-5e2d-4185-922d-fdd05aa6dbcb service nova] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-123a2b0f-4e59-4b5b-9fa5-b9cef6d75c08 req-4106ec89-5e2d-4185-922d-fdd05aa6dbcb service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] No waiting events found dispatching network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:07:25 user nova-compute[75020]: WARNING nova.compute.manager [req-123a2b0f-4e59-4b5b-9fa5-b9cef6d75c08 req-4106ec89-5e2d-4185-922d-fdd05aa6dbcb service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received unexpected event network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b for instance with vm_state building and task_state spawning.
Nov 30 11:07:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-123a2b0f-4e59-4b5b-9fa5-b9cef6d75c08 req-4106ec89-5e2d-4185-922d-fdd05aa6dbcb service nova] [instance: d88214a8-f7f1-4735-8faf-611d70a77d9f] Received event network-vif-deleted-f756ed97-6717-4f69-b7ea-3e503a0d7bf2 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:07:26 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Instance spawned successfully.
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:07:26 user nova-compute[75020]: INFO nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 30 11:07:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:07:26 user nova-compute[75020]: INFO nova.compute.manager [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Took 6.42 seconds to build instance.
Nov 30 11:07:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bac7b97b-9eaf-4d44-83a4-16eb4287e8c5 tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.514s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:30 user nova-compute[75020]: INFO nova.compute.manager [None req-fb452024-d026-4f15-8ecb-9b1caf128510 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Unrescuing
Nov 30 11:07:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fb452024-d026-4f15-8ecb-9b1caf128510 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:07:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fb452024-d026-4f15-8ecb-9b1caf128510 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquired lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:07:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fb452024-d026-4f15-8ecb-9b1caf128510 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:07:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fb452024-d026-4f15-8ecb-9b1caf128510 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:07:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fb452024-d026-4f15-8ecb-9b1caf128510 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Releasing lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:07:30 user nova-compute[75020]: DEBUG nova.objects.instance [None req-fb452024-d026-4f15-8ecb-9b1caf128510 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'flavor' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:07:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-6130b425-e7d6-42a9-892b-9f9712b17108 req-c5977e83-d2c9-4853-b3b5-c30a33417a13 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6130b425-e7d6-42a9-892b-9f9712b17108 req-c5977e83-d2c9-4853-b3b5-c30a33417a13 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6130b425-e7d6-42a9-892b-9f9712b17108 req-c5977e83-d2c9-4853-b3b5-c30a33417a13 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6130b425-e7d6-42a9-892b-9f9712b17108 req-c5977e83-d2c9-4853-b3b5-c30a33417a13 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-6130b425-e7d6-42a9-892b-9f9712b17108 req-c5977e83-d2c9-4853-b3b5-c30a33417a13 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:07:31 user nova-compute[75020]: WARNING nova.compute.manager [req-6130b425-e7d6-42a9-892b-9f9712b17108 req-c5977e83-d2c9-4853-b3b5-c30a33417a13 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:07:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:31 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance destroyed successfully.
Nov 30 11:07:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:07:33 user nova-compute[75020]: WARNING nova.compute.manager [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:07:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:07:33 user nova-compute[75020]: WARNING nova.compute.manager [req-543faf78-6a1f-4f68-842e-de73af6925b2 req-15f64c0f-a43f-46c3-ae33-e75a07feb491 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state rescued and task_state unrescuing.
Nov 30 11:07:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fb452024-d026-4f15-8ecb-9b1caf128510 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:07:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-e14d7e54-abb6-4de4-ad34-7894eceade27 req-fd028cce-5996-42b7-9864-9bbc657a60fd service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:07:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e14d7e54-abb6-4de4-ad34-7894eceade27 req-fd028cce-5996-42b7-9864-9bbc657a60fd service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e14d7e54-abb6-4de4-ad34-7894eceade27 req-fd028cce-5996-42b7-9864-9bbc657a60fd service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e14d7e54-abb6-4de4-ad34-7894eceade27 req-fd028cce-5996-42b7-9864-9bbc657a60fd service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-e14d7e54-abb6-4de4-ad34-7894eceade27 req-fd028cce-5996-42b7-9864-9bbc657a60fd service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:07:35 user nova-compute[75020]: WARNING nova.compute.manager [req-e14d7e54-abb6-4de4-ad34-7894eceade27 req-fd028cce-5996-42b7-9864-9bbc657a60fd service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state active and task_state None.
Nov 30 11:07:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:07:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:07:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:07:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:07:56 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:07:56 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updating instance_info_cache with network_info: [{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:07:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:07:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:07:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:07:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:08:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8102MB free_disk=25.166160583496094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 64faec4f-7e2b-40cd-b061-bea6da2e18d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1bba3d30-a9d1-4715-bb7b-ed4674da2528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:08:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.336s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:08:01 user nova-compute[75020]: INFO nova.compute.claims [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Claim successful on node user
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:08:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.policy [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a5d2305e8d346009c88bb5324446309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f399c3a5bd2d4acf815b09df902f226c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:08:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Creating image(s)
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk 1073741824" returned: 0 in 0.053s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Successfully created port: 503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Cannot resize image /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Ensure instance console log exists: /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Successfully updated port: 503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-12eef360-5ff8-4114-ae22-bc41338f7d12 req-4aa2a493-b547-4ccc-9c32-0f3e6b2078a4 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-changed-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-12eef360-5ff8-4114-ae22-bc41338f7d12 req-4aa2a493-b547-4ccc-9c32-0f3e6b2078a4 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Refreshing instance network info cache due to event network-changed-503a9796-e188-4a72-a429-df54ae6acc01. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-12eef360-5ff8-4114-ae22-bc41338f7d12 req-4aa2a493-b547-4ccc-9c32-0f3e6b2078a4 service nova] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:08:02 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance network_info: |[{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-12eef360-5ff8-4114-ae22-bc41338f7d12 req-4aa2a493-b547-4ccc-9c32-0f3e6b2078a4 service nova] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-12eef360-5ff8-4114-ae22-bc41338f7d12 req-4aa2a493-b547-4ccc-9c32-0f3e6b2078a4 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Refreshing network info cache for port 503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Start _get_guest_xml network_info=[{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:08:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:08:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lazy-loading 'pci_devices' on Instance uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:08:03 user nova-compute[75020]:   <uuid>edfaac3a-50a5-4b24-881e-cb5a6baedbae</uuid>
Nov 30 11:08:03 user nova-compute[75020]:   <name>instance-00000026</name>
Nov 30 11:08:03 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:08:03 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:08:03 user nova-compute[75020]:   <metadata>
Nov 30 11:08:03 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:08:03 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:08:03 user nova-compute[75020]:       <nova:name>tempest-ServerActionsTestOtherB-server-1598589341</nova:name>
Nov 30 11:08:03 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:08:03</nova:creationTime>
Nov 30 11:08:03 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:08:03 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:08:03 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:08:03 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:08:03 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:08:03 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:08:03 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:08:03 user nova-compute[75020]:       <nova:owner>
Nov 30 11:08:03 user nova-compute[75020]:         <nova:user uuid="5a5d2305e8d346009c88bb5324446309">tempest-ServerActionsTestOtherB-561456809-project-member</nova:user>
Nov 30 11:08:03 user nova-compute[75020]:         <nova:project uuid="f399c3a5bd2d4acf815b09df902f226c">tempest-ServerActionsTestOtherB-561456809</nova:project>
Nov 30 11:08:03 user nova-compute[75020]:       </nova:owner>
Nov 30 11:08:03 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:08:03 user nova-compute[75020]:       <nova:ports>
Nov 30 11:08:03 user nova-compute[75020]:         <nova:port uuid="503a9796-e188-4a72-a429-df54ae6acc01">
Nov 30 11:08:03 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 11:08:03 user nova-compute[75020]:         </nova:port>
Nov 30 11:08:03 user nova-compute[75020]:       </nova:ports>
Nov 30 11:08:03 user nova-compute[75020]:     </nova:instance>
Nov 30 11:08:03 user nova-compute[75020]:   </metadata>
Nov 30 11:08:03 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:08:03 user nova-compute[75020]:     <system>
Nov 30 11:08:03 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:08:03 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:08:03 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:08:03 user nova-compute[75020]:       <entry name="serial">edfaac3a-50a5-4b24-881e-cb5a6baedbae</entry>
Nov 30 11:08:03 user nova-compute[75020]:       <entry name="uuid">edfaac3a-50a5-4b24-881e-cb5a6baedbae</entry>
Nov 30 11:08:03 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:08:03 user nova-compute[75020]:     </system>
Nov 30 11:08:03 user nova-compute[75020]:   </sysinfo>
Nov 30 11:08:03 user nova-compute[75020]:   <os>
Nov 30 11:08:03 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:08:03 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:08:03 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:08:03 user nova-compute[75020]:   </os>
Nov 30 11:08:03 user nova-compute[75020]:   <features>
Nov 30 11:08:03 user nova-compute[75020]:     <acpi/>
Nov 30 11:08:03 user nova-compute[75020]:     <apic/>
Nov 30 11:08:03 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:08:03 user nova-compute[75020]:   </features>
Nov 30 11:08:03 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:08:03 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:08:03 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:08:03 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:08:03 user nova-compute[75020]:   </clock>
Nov 30 11:08:03 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:08:03 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:08:03 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:08:03 user nova-compute[75020]:   </cpu>
Nov 30 11:08:03 user nova-compute[75020]:   <devices>
Nov 30 11:08:03 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:08:03 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:08:03 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk"/>
Nov 30 11:08:03 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:08:03 user nova-compute[75020]:     </disk>
Nov 30 11:08:03 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:08:03 user nova-compute[75020]:       <mac address="fa:16:3e:4b:ea:b1"/>
Nov 30 11:08:03 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:08:03 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:08:03 user nova-compute[75020]:       <target dev="tap503a9796-e1"/>
Nov 30 11:08:03 user nova-compute[75020]:     </interface>
Nov 30 11:08:03 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:08:03 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/console.log" append="off"/>
Nov 30 11:08:03 user nova-compute[75020]:     </serial>
Nov 30 11:08:03 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:08:03 user nova-compute[75020]:     <video>
Nov 30 11:08:03 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:08:03 user nova-compute[75020]:     </video>
Nov 30 11:08:03 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:08:03 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:08:03 user nova-compute[75020]:     </rng>
Nov 30 11:08:03 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:08:03 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:08:03 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:08:03 user nova-compute[75020]:     </memballoon>
Nov 30 11:08:03 user nova-compute[75020]:   </devices>
Nov 30 11:08:03 user nova-compute[75020]: </domain>
Nov 30 11:08:03 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG os_vif [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eab15340-2dc3-5550-928c-2770e56a2345', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap503a9796-e1, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap503a9796-e1, col_values=(('qos', UUID('328b1d88-fd45-496b-bb80-15c1e731c3b7')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap503a9796-e1, col_values=(('external_ids', {'iface-id': '503a9796-e188-4a72-a429-df54ae6acc01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:ea:b1', 'vm-uuid': 'edfaac3a-50a5-4b24-881e-cb5a6baedbae'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:03 user nova-compute[75020]: INFO os_vif [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1')
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] No VIF found with MAC fa:16:3e:4b:ea:b1, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-12eef360-5ff8-4114-ae22-bc41338f7d12 req-4aa2a493-b547-4ccc-9c32-0f3e6b2078a4 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updated VIF entry in instance network info cache for port 503a9796-e188-4a72-a429-df54ae6acc01. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG nova.network.neutron [req-12eef360-5ff8-4114-ae22-bc41338f7d12 req-4aa2a493-b547-4ccc-9c32-0f3e6b2078a4 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:08:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-12eef360-5ff8-4114-ae22-bc41338f7d12 req-4aa2a493-b547-4ccc-9c32-0f3e6b2078a4 service nova] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:08:04 user nova-compute[75020]: WARNING nova.compute.manager [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state building and task_state spawning.
Nov 30 11:08:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:08:04 user nova-compute[75020]: WARNING nova.compute.manager [req-5942d497-9823-46db-9d36-bf8025286214 req-a726b051-bfe5-46d2-a9d7-4cd360601334 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state building and task_state spawning.
Nov 30 11:08:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:08:06 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance spawned successfully.
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:08:06 user nova-compute[75020]: INFO nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 30 11:08:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:08:06 user nova-compute[75020]: INFO nova.compute.manager [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Took 5.94 seconds to build instance.
Nov 30 11:08:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0b52df4b-4ad0-4538-9239-c0737db4a45f tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.369s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:08:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:08:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:08:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:08:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:08:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-cbc7dd23-cc99-446d-af1c-eb8c07f4e153 req-8798bd6c-df68-4bac-86f4-7055f971d822 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received event network-changed-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:29 user nova-compute[75020]: DEBUG nova.compute.manager [req-cbc7dd23-cc99-446d-af1c-eb8c07f4e153 req-8798bd6c-df68-4bac-86f4-7055f971d822 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Refreshing instance network info cache due to event network-changed-e231c110-67d6-4736-994d-2c2b54881991. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:08:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cbc7dd23-cc99-446d-af1c-eb8c07f4e153 req-8798bd6c-df68-4bac-86f4-7055f971d822 service nova] Acquiring lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:08:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cbc7dd23-cc99-446d-af1c-eb8c07f4e153 req-8798bd6c-df68-4bac-86f4-7055f971d822 service nova] Acquired lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:08:29 user nova-compute[75020]: DEBUG nova.network.neutron [req-cbc7dd23-cc99-446d-af1c-eb8c07f4e153 req-8798bd6c-df68-4bac-86f4-7055f971d822 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Refreshing network info cache for port e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG nova.network.neutron [req-cbc7dd23-cc99-446d-af1c-eb8c07f4e153 req-8798bd6c-df68-4bac-86f4-7055f971d822 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Updated VIF entry in instance network info cache for port e231c110-67d6-4736-994d-2c2b54881991. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG nova.network.neutron [req-cbc7dd23-cc99-446d-af1c-eb8c07f4e153 req-8798bd6c-df68-4bac-86f4-7055f971d822 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Updating instance_info_cache with network_info: [{"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cbc7dd23-cc99-446d-af1c-eb8c07f4e153 req-8798bd6c-df68-4bac-86f4-7055f971d822 service nova] Releasing lock "refresh_cache-67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:30 user nova-compute[75020]: INFO nova.compute.manager [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Terminating instance
Nov 30 11:08:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-085a108b-1bc2-41a6-9962-3ddbf9fe7de6 req-8f43d9c6-e695-4295-bcb4-2a9402beeddf service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received event network-vif-unplugged-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-085a108b-1bc2-41a6-9962-3ddbf9fe7de6 req-8f43d9c6-e695-4295-bcb4-2a9402beeddf service nova] Acquiring lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-085a108b-1bc2-41a6-9962-3ddbf9fe7de6 req-8f43d9c6-e695-4295-bcb4-2a9402beeddf service nova] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-085a108b-1bc2-41a6-9962-3ddbf9fe7de6 req-8f43d9c6-e695-4295-bcb4-2a9402beeddf service nova] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-085a108b-1bc2-41a6-9962-3ddbf9fe7de6 req-8f43d9c6-e695-4295-bcb4-2a9402beeddf service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] No waiting events found dispatching network-vif-unplugged-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:08:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-085a108b-1bc2-41a6-9962-3ddbf9fe7de6 req-8f43d9c6-e695-4295-bcb4-2a9402beeddf service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received event network-vif-unplugged-e231c110-67d6-4736-994d-2c2b54881991 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:08:31 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Instance destroyed successfully.
Nov 30 11:08:31 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'resources' on Instance uuid 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1889575090',display_name='tempest-TestVolumeBootPattern-server-1889575090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1889575090',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-dmrh0su8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:06:53Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "e231c110-67d6-4736-994d-2c2b54881991", "address": "fa:16:3e:23:a5:a4", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape231c110-67", "ovs_interfaceid": "e231c110-67d6-4736-994d-2c2b54881991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:a5:a4,bridge_name='br-int',has_traffic_filtering=True,id=e231c110-67d6-4736-994d-2c2b54881991,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape231c110-67') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_vif [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:a5:a4,bridge_name='br-int',has_traffic_filtering=True,id=e231c110-67d6-4736-994d-2c2b54881991,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape231c110-67') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape231c110-67, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb303e0f-a4af-45b4-a4d3-dde0ca2d9c6e) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:08:31 user nova-compute[75020]: INFO os_vif [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:a5:a4,bridge_name='br-int',has_traffic_filtering=True,id=e231c110-67d6-4736-994d-2c2b54881991,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape231c110-67')
Nov 30 11:08:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZItoOes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:08:31 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4148ecd9-323f-4b06-90df-884d04e2f633]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:08:31 user nova-compute[75020]: No targets found.
Nov 30 11:08:31 user nova-compute[75020]: iSNS:
Nov 30 11:08:31 user nova-compute[75020]: No targets found.
Nov 30 11:08:31 user nova-compute[75020]: STATIC:
Nov 30 11:08:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9
Nov 30 11:08:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:08:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:08:31 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:08:31 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:08:31 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:08:31 user nova-compute[75020]: FIRMWARE:
Nov 30 11:08:31 user nova-compute[75020]: No targets found.
Nov 30 11:08:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:08:31 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:08:31 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9866af54-99ed-4e52-a0a0-3e9e270836a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd61dc-ab28-4c0f-ad93-64d78e5b1a30]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:08:31 user nova-compute[75020]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:08:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:08:31 user nova-compute[75020]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:08:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada8198790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4286f06-c197-4460-8048-1fcde88965de]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab51736-4ccf-4090-b4a3-52f121a242be]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f8ad1-884b-40f5-8842-c631d3cb9951]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ef7913-d41e-4662-b616-1833ef99b741]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOccdafd04-f8d20f53af6c0718', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ccdafd04', '/dev/disk/by-id/scsi-26638643230663533') {{(pid=86371) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d36c7-4756-4a71-800d-d88dedc81185]: (4, None) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25df8bd-9244-4489-bccc-90902532b623]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0d2a3a-b781-4c9d-b387-c333fa90a2ef]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260]
Nov 30 11:08:31 user nova-compute[75020]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260] successful.
Nov 30 11:08:31 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a9a78-532d-4a4e-b52a-9625ac3ed780]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== disconnect_volume: return (312ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:08:31 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Deleting instance files /opt/stack/data/nova/instances/67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb_del
Nov 30 11:08:31 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Deletion of /opt/stack/data/nova/instances/67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb_del complete
Nov 30 11:08:31 user nova-compute[75020]: INFO nova.compute.manager [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 30 11:08:31 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:08:31 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:08:32 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:08:32 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Took 0.81 seconds to deallocate network for instance.
Nov 30 11:08:32 user nova-compute[75020]: DEBUG nova.compute.manager [req-4599e5ab-2a64-4182-b9dd-b3f2948cd231 req-eea9581d-9f2f-42a0-8083-3ffe2805b9fb service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received event network-vif-deleted-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:32 user nova-compute[75020]: DEBUG nova.compute.manager [req-50d9bb71-a38c-426c-9631-0ae84aaf3c3b req-7b9d7b96-3360-4d8e-ac57-e51e82bb2204 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received event network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-50d9bb71-a38c-426c-9631-0ae84aaf3c3b req-7b9d7b96-3360-4d8e-ac57-e51e82bb2204 service nova] Acquiring lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-50d9bb71-a38c-426c-9631-0ae84aaf3c3b req-7b9d7b96-3360-4d8e-ac57-e51e82bb2204 service nova] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-50d9bb71-a38c-426c-9631-0ae84aaf3c3b req-7b9d7b96-3360-4d8e-ac57-e51e82bb2204 service nova] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:32 user nova-compute[75020]: DEBUG nova.compute.manager [req-50d9bb71-a38c-426c-9631-0ae84aaf3c3b req-7b9d7b96-3360-4d8e-ac57-e51e82bb2204 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] No waiting events found dispatching network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:08:32 user nova-compute[75020]: WARNING nova.compute.manager [req-50d9bb71-a38c-426c-9631-0ae84aaf3c3b req-7b9d7b96-3360-4d8e-ac57-e51e82bb2204 service nova] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Received unexpected event network-vif-plugged-e231c110-67d6-4736-994d-2c2b54881991 for instance with vm_state active and task_state deleting.
Nov 30 11:08:33 user nova-compute[75020]: INFO nova.compute.manager [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb] Took 0.88 seconds to detach 1 volumes for instance.
Nov 30 11:08:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:33 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:08:33 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:08:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:33 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Deleted allocations for instance 67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb
Nov 30 11:08:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8ff8914a-abc9-4572-b26a-9a03a224f486 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "67ba4d03-8fb4-4cab-ba3c-daf8303a0bfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.374s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:42 user nova-compute[75020]: INFO nova.compute.manager [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Terminating instance
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-49b35e68-d51a-413a-8df0-efcb69a8bfd2 req-2436d64a-fd16-4f56-9b3e-47e6160934ec service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received event network-vif-unplugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49b35e68-d51a-413a-8df0-efcb69a8bfd2 req-2436d64a-fd16-4f56-9b3e-47e6160934ec service nova] Acquiring lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49b35e68-d51a-413a-8df0-efcb69a8bfd2 req-2436d64a-fd16-4f56-9b3e-47e6160934ec service nova] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-49b35e68-d51a-413a-8df0-efcb69a8bfd2 req-2436d64a-fd16-4f56-9b3e-47e6160934ec service nova] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-49b35e68-d51a-413a-8df0-efcb69a8bfd2 req-2436d64a-fd16-4f56-9b3e-47e6160934ec service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] No waiting events found dispatching network-vif-unplugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-49b35e68-d51a-413a-8df0-efcb69a8bfd2 req-2436d64a-fd16-4f56-9b3e-47e6160934ec service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received event network-vif-unplugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:08:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Instance destroyed successfully.
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lazy-loading 'resources' on Instance uuid 64faec4f-7e2b-40cd-b061-bea6da2e18d3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-617813740',display_name='tempest-VolumesActionsTest-instance-617813740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-617813740',id=36,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:06:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef0273db32a544b7861db7e9c230b963',ramdisk_id='',reservation_id='r-sz0v2jn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1089300411',owner_user_name='tempest-VolumesActionsTest-1089300411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:06:59Z,user_data=None,user_id='007c1fe9701d4950a6f3e69faea04afc',uuid=64faec4f-7e2b-40cd-b061-bea6da2e18d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converting VIF {"id": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "address": "fa:16:3e:b7:bb:c4", "network": {"id": "2dbad5f5-5484-400c-95b9-cebea0d82bd1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-737483041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef0273db32a544b7861db7e9c230b963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf13bb7d-49", "ovs_interfaceid": "bf13bb7d-495c-45d8-a8d6-b0d13c6cdade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=bf13bb7d-495c-45d8-a8d6-b0d13c6cdade,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf13bb7d-49') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG os_vif [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=bf13bb7d-495c-45d8-a8d6-b0d13c6cdade,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf13bb7d-49') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf13bb7d-49, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b36b32a3-9fca-473d-b4d5-7263ad0cce11) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:42 user nova-compute[75020]: INFO os_vif [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=bf13bb7d-495c-45d8-a8d6-b0d13c6cdade,network=Network(2dbad5f5-5484-400c-95b9-cebea0d82bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf13bb7d-49')
Nov 30 11:08:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Deleting instance files /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3_del
Nov 30 11:08:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Deletion of /opt/stack/data/nova/instances/64faec4f-7e2b-40cd-b061-bea6da2e18d3_del complete
Nov 30 11:08:42 user nova-compute[75020]: INFO nova.compute.manager [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 30 11:08:42 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:08:42 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:08:43 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:08:43 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Took 0.43 seconds to deallocate network for instance.
Nov 30 11:08:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-8b0885de-1df3-4298-8c1b-fab53211a587 req-5bdfc0d2-da61-4d2c-a566-93f1582de3a5 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received event network-vif-deleted-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:43 user nova-compute[75020]: INFO nova.compute.manager [req-8b0885de-1df3-4298-8c1b-fab53211a587 req-5bdfc0d2-da61-4d2c-a566-93f1582de3a5 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Neutron deleted interface bf13bb7d-495c-45d8-a8d6-b0d13c6cdade; detaching it from the instance and deleting it from the info cache
Nov 30 11:08:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-8b0885de-1df3-4298-8c1b-fab53211a587 req-5bdfc0d2-da61-4d2c-a566-93f1582de3a5 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:08:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-8b0885de-1df3-4298-8c1b-fab53211a587 req-5bdfc0d2-da61-4d2c-a566-93f1582de3a5 service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Detach interface failed, port_id=bf13bb7d-495c-45d8-a8d6-b0d13c6cdade, reason: Instance 64faec4f-7e2b-40cd-b061-bea6da2e18d3 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 11:08:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:43 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:08:43 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:08:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:43 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Deleted allocations for instance 64faec4f-7e2b-40cd-b061-bea6da2e18d3
Nov 30 11:08:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bba3a0d9-87e3-4e59-af75-cac73d070341 tempest-VolumesActionsTest-1089300411 tempest-VolumesActionsTest-1089300411-project-member] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.523s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-4c5f56f2-c3bd-4ce4-b86d-bf2615529e76 req-e452302a-b39e-495e-a43f-105cb94859af service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received event network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:08:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4c5f56f2-c3bd-4ce4-b86d-bf2615529e76 req-e452302a-b39e-495e-a43f-105cb94859af service nova] Acquiring lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4c5f56f2-c3bd-4ce4-b86d-bf2615529e76 req-e452302a-b39e-495e-a43f-105cb94859af service nova] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4c5f56f2-c3bd-4ce4-b86d-bf2615529e76 req-e452302a-b39e-495e-a43f-105cb94859af service nova] Lock "64faec4f-7e2b-40cd-b061-bea6da2e18d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-4c5f56f2-c3bd-4ce4-b86d-bf2615529e76 req-e452302a-b39e-495e-a43f-105cb94859af service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] No waiting events found dispatching network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:08:44 user nova-compute[75020]: WARNING nova.compute.manager [req-4c5f56f2-c3bd-4ce4-b86d-bf2615529e76 req-e452302a-b39e-495e-a43f-105cb94859af service nova] [instance: 64faec4f-7e2b-40cd-b061-bea6da2e18d3] Received unexpected event network-vif-plugged-bf13bb7d-495c-45d8-a8d6-b0d13c6cdade for instance with vm_state deleted and task_state None.
Nov 30 11:08:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:08:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:08:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:08:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:08:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:08:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:08:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:08:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:08:56 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:08:56 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updating instance_info_cache with network_info: [{"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:08:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:08:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:08:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:08:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:08:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:09:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:09:00 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8303MB free_disk=25.16281509399414GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:09:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 1bba3d30-a9d1-4715-bb7b-ed4674da2528 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:09:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:09:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:09:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:09:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:09:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:09 user nova-compute[75020]: INFO nova.compute.manager [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Terminating instance
Nov 30 11:09:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-e98b9ef0-28fe-477d-880c-748c85720d78 req-b8aaeba3-7ad9-4776-be44-e072d2448e37 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received event network-vif-unplugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e98b9ef0-28fe-477d-880c-748c85720d78 req-b8aaeba3-7ad9-4776-be44-e072d2448e37 service nova] Acquiring lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e98b9ef0-28fe-477d-880c-748c85720d78 req-b8aaeba3-7ad9-4776-be44-e072d2448e37 service nova] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e98b9ef0-28fe-477d-880c-748c85720d78 req-b8aaeba3-7ad9-4776-be44-e072d2448e37 service nova] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-e98b9ef0-28fe-477d-880c-748c85720d78 req-b8aaeba3-7ad9-4776-be44-e072d2448e37 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] No waiting events found dispatching network-vif-unplugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-e98b9ef0-28fe-477d-880c-748c85720d78 req-b8aaeba3-7ad9-4776-be44-e072d2448e37 service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received event network-vif-unplugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:09:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Instance destroyed successfully.
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.objects.instance [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lazy-loading 'resources' on Instance uuid 1bba3d30-a9d1-4715-bb7b-ed4674da2528 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1913238620',display_name='tempest-VolumesNegativeTest-instance-1913238620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1913238620',id=37,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd080614cc9e49ffa242d4a771a56ba3',ramdisk_id='',reservation_id='r-1lgpthw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1578618755',owner_user_name='tempest-VolumesNegativeTest-1578618755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:07:26Z,user_data=None,user_id='0478b31803ad4dc6bd3b685958845c04',uuid=1bba3d30-a9d1-4715-bb7b-ed4674da2528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Converting VIF {"id": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "address": "fa:16:3e:d6:13:a7", "network": {"id": "ac9a6e5a-a22b-403c-ae36-91766f6a8235", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "96dfc3e6d05049898231099132483b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9c5552-4b", "ovs_interfaceid": "ee9c5552-4b5b-4573-883f-5a3b91a7802b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee9c5552-4b5b-4573-883f-5a3b91a7802b,network=Network(ac9a6e5a-a22b-403c-ae36-91766f6a8235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9c5552-4b') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG os_vif [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee9c5552-4b5b-4573-883f-5a3b91a7802b,network=Network(ac9a6e5a-a22b-403c-ae36-91766f6a8235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9c5552-4b') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee9c5552-4b, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e517f7e4-d5f4-4789-9b29-2cc609b560ae) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:09:10 user nova-compute[75020]: INFO os_vif [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:a7,bridge_name='br-int',has_traffic_filtering=True,id=ee9c5552-4b5b-4573-883f-5a3b91a7802b,network=Network(ac9a6e5a-a22b-403c-ae36-91766f6a8235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9c5552-4b')
Nov 30 11:09:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Deleting instance files /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528_del
Nov 30 11:09:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Deletion of /opt/stack/data/nova/instances/1bba3d30-a9d1-4715-bb7b-ed4674da2528_del complete
Nov 30 11:09:10 user nova-compute[75020]: INFO nova.compute.manager [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 30 11:09:10 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:09:10 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:09:11 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:09:11 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Took 0.43 seconds to deallocate network for instance.
Nov 30 11:09:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:11 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:09:11 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:09:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:11 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Deleted allocations for instance 1bba3d30-a9d1-4715-bb7b-ed4674da2528
Nov 30 11:09:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-73aaf20f-f683-49e8-bf23-60295ac02a4a tempest-VolumesNegativeTest-1578618755 tempest-VolumesNegativeTest-1578618755-project-member] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.522s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-925620f8-8eef-4a94-9297-eec34239e0bd req-1043b28b-e8b7-4dd3-b629-756e45fe410d service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received event network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-925620f8-8eef-4a94-9297-eec34239e0bd req-1043b28b-e8b7-4dd3-b629-756e45fe410d service nova] Acquiring lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-925620f8-8eef-4a94-9297-eec34239e0bd req-1043b28b-e8b7-4dd3-b629-756e45fe410d service nova] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-925620f8-8eef-4a94-9297-eec34239e0bd req-1043b28b-e8b7-4dd3-b629-756e45fe410d service nova] Lock "1bba3d30-a9d1-4715-bb7b-ed4674da2528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-925620f8-8eef-4a94-9297-eec34239e0bd req-1043b28b-e8b7-4dd3-b629-756e45fe410d service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] No waiting events found dispatching network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:09:12 user nova-compute[75020]: WARNING nova.compute.manager [req-925620f8-8eef-4a94-9297-eec34239e0bd req-1043b28b-e8b7-4dd3-b629-756e45fe410d service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received unexpected event network-vif-plugged-ee9c5552-4b5b-4573-883f-5a3b91a7802b for instance with vm_state deleted and task_state None.
Nov 30 11:09:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-925620f8-8eef-4a94-9297-eec34239e0bd req-1043b28b-e8b7-4dd3-b629-756e45fe410d service nova] [instance: 1bba3d30-a9d1-4715-bb7b-ed4674da2528] Received event network-vif-deleted-ee9c5552-4b5b-4573-883f-5a3b91a7802b {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:19 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:09:22 user nova-compute[75020]: INFO nova.compute.claims [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Claim successful on node user
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-d9be46f4-dd5c-4e53-ae5d-8e0f215178ed req-c9729bc7-65ac-40fa-be22-dad82a5e60ec service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-changed-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-d9be46f4-dd5c-4e53-ae5d-8e0f215178ed req-c9729bc7-65ac-40fa-be22-dad82a5e60ec service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Refreshing instance network info cache due to event network-changed-903ec885-1189-4bde-be19-0d7cabee638e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9be46f4-dd5c-4e53-ae5d-8e0f215178ed req-c9729bc7-65ac-40fa-be22-dad82a5e60ec service nova] Acquiring lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9be46f4-dd5c-4e53-ae5d-8e0f215178ed req-c9729bc7-65ac-40fa-be22-dad82a5e60ec service nova] Acquired lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-d9be46f4-dd5c-4e53-ae5d-8e0f215178ed req-c9729bc7-65ac-40fa-be22-dad82a5e60ec service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Refreshing network info cache for port 903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:09:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:09:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:09:23 user nova-compute[75020]: INFO nova.virt.block_device [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Booting with volume 02160fe3-2891-461b-85c9-8a92451ef62e at /dev/vda
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.policy [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19afae8899f440c78b8a442361d5b531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c52e77c7064c97bc18c9df58ae20ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG os_brick.utils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a352819-5e1c-4fc2-bf3b-f244be500062]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c04108a-7467-4be7-a6a7-47e319ba7a4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a411e-ac7c-4b30-bae4-0be5ea207e16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383ae96-f367-4ddd-99fb-c99b4880cd42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:09:23 user nova-compute[75020]: INFO nova.compute.manager [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Detaching volume e79b492c-9689-4b8c-b9b1-8365250b90f9
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:09:23 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da26f9a-e6f1-4cff-b0e3-4f9263323a9f]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG os_brick.utils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updating existing volume attachment record: bd9e98f1-aed4-436c-95e8-2705237db68f {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:09:23 user nova-compute[75020]: INFO nova.virt.block_device [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Attempting to driver detach volume e79b492c-9689-4b8c-b9b1-8365250b90f9 from mountpoint /dev/vdb
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Attempting to detach device vdb from instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:09:23 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:09:23 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:09:23 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:09:23 user nova-compute[75020]:   <serial>e79b492c-9689-4b8c-b9b1-8365250b90f9</serial>
Nov 30 11:09:23 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:09:23 user nova-compute[75020]: </disk>
Nov 30 11:09:23 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:09:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Successfully detached device vdb from instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 from the persistent domain config.
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:09:23 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:09:23 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:09:23 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:09:23 user nova-compute[75020]:   <serial>e79b492c-9689-4b8c-b9b1-8365250b90f9</serial>
Nov 30 11:09:23 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:09:23 user nova-compute[75020]: </disk>
Nov 30 11:09:23 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-d9be46f4-dd5c-4e53-ae5d-8e0f215178ed req-c9729bc7-65ac-40fa-be22-dad82a5e60ec service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updated VIF entry in instance network info cache for port 903ec885-1189-4bde-be19-0d7cabee638e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-d9be46f4-dd5c-4e53-ae5d-8e0f215178ed req-c9729bc7-65ac-40fa-be22-dad82a5e60ec service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9be46f4-dd5c-4e53-ae5d-8e0f215178ed req-c9729bc7-65ac-40fa-be22-dad82a5e60ec service nova] Releasing lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:09:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Successfully created port: cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-6e5e63ae-08e3-4a4c-8824-765ee1d58133 req-5e210e02-87af-489e-a420-130c586f963b service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-changed-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-6e5e63ae-08e3-4a4c-8824-765ee1d58133 req-5e210e02-87af-489e-a420-130c586f963b service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Refreshing instance network info cache due to event network-changed-903ec885-1189-4bde-be19-0d7cabee638e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6e5e63ae-08e3-4a4c-8824-765ee1d58133 req-5e210e02-87af-489e-a420-130c586f963b service nova] Acquiring lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6e5e63ae-08e3-4a4c-8824-765ee1d58133 req-5e210e02-87af-489e-a420-130c586f963b service nova] Acquired lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.network.neutron [req-6e5e63ae-08e3-4a4c-8824-765ee1d58133 req-5e210e02-87af-489e-a420-130c586f963b service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Refreshing network info cache for port 903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Successfully updated port: cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquired lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-451d79cd-d951-4866-8b2c-f3bd083d0bd3 req-3050973c-0964-4ec2-8b92-883f334cd497 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-changed-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-451d79cd-d951-4866-8b2c-f3bd083d0bd3 req-3050973c-0964-4ec2-8b92-883f334cd497 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Refreshing instance network info cache due to event network-changed-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-451d79cd-d951-4866-8b2c-f3bd083d0bd3 req-3050973c-0964-4ec2-8b92-883f334cd497 service nova] Acquiring lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:09:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG nova.network.neutron [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updating instance_info_cache with network_info: [{"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Releasing lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Instance network_info: |[{"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-451d79cd-d951-4866-8b2c-f3bd083d0bd3 req-3050973c-0964-4ec2-8b92-883f334cd497 service nova] Acquired lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG nova.network.neutron [req-451d79cd-d951-4866-8b2c-f3bd083d0bd3 req-3050973c-0964-4ec2-8b92-883f334cd497 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Refreshing network info cache for port cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG nova.network.neutron [req-6e5e63ae-08e3-4a4c-8824-765ee1d58133 req-5e210e02-87af-489e-a420-130c586f963b service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updated VIF entry in instance network info cache for port 903ec885-1189-4bde-be19-0d7cabee638e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG nova.network.neutron [req-6e5e63ae-08e3-4a4c-8824-765ee1d58133 req-5e210e02-87af-489e-a420-130c586f963b service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6e5e63ae-08e3-4a4c-8824-765ee1d58133 req-5e210e02-87af-489e-a420-130c586f963b service nova] Releasing lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG nova.network.neutron [req-451d79cd-d951-4866-8b2c-f3bd083d0bd3 req-3050973c-0964-4ec2-8b92-883f334cd497 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updated VIF entry in instance network info cache for port cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG nova.network.neutron [req-451d79cd-d951-4866-8b2c-f3bd083d0bd3 req-3050973c-0964-4ec2-8b92-883f334cd497 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updating instance_info_cache with network_info: [{"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:09:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-451d79cd-d951-4866-8b2c-f3bd083d0bd3 req-3050973c-0964-4ec2-8b92-883f334cd497 service nova] Releasing lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:09:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:09:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:09:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:09:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:09:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:09:32 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Creating image(s)
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Ensure instance console log exists: /opt/stack/data/nova/instances/aaee883f-b87b-43c2-af7c-dfb8a7a42c05/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Start _get_guest_xml network_info=[{"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'bd9e98f1-aed4-436c-95e8-2705237db68f', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZItoOes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aaee883f-b87b-43c2-af7c-dfb8a7a42c05', 'attached_at': '', 'detached_at': '', 'volume_id': '02160fe3-2891-461b-85c9-8a92451ef62e', 'serial': '02160fe3-2891-461b-85c9-8a92451ef62e'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:09:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:09:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZItoOes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:09:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:09:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:09:32 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb4596f-8830-4f62-abbb-62efb97a5f97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:09:32 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[47519d51-dafc-49be-86e0-14acaf3a0e45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e] added
Nov 30 11:09:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2194138f-2bd7-4c34-8168-96579e9e450e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc619944-478e-4434-a070-df8d05a1025d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZItoOes {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZItoOes" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c96ea9-b47e-4092-913f-b78912ff1f56]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZItoOes'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6682b41-d1c8-4bcb-be53-24dbe9693046]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca41ab5-0d2e-47b1-a4f8-02e7fd2901b4]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:09:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:09:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee74244d-f2f2-47af-a0aa-782e7332ae5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260]
Nov 30 11:09:32 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260] successful.
Nov 30 11:09:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4449a5-7165-48c3-a700-da8a9a570f8e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[02608516-a55c-4353-8908-76b15e9c91c9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:09:32 user nova-compute[75020]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:09:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:09:32 user nova-compute[75020]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:09:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7216196-f572-4f22-92a2-343df5f87392]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:09:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZItoOes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26638643230663533', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638643230663533', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1488346503',display_name='tempest-TestVolumeBootPattern-server-1488346503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1488346503',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-qlm0bc4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:09:23Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=aaee883f-b87b-43c2-af7c-dfb8a7a42c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e92cc-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.objects.instance [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'pci_devices' on Instance uuid aaee883f-b87b-43c2-af7c-dfb8a7a42c05 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:09:33 user nova-compute[75020]:   <uuid>aaee883f-b87b-43c2-af7c-dfb8a7a42c05</uuid>
Nov 30 11:09:33 user nova-compute[75020]:   <name>instance-00000027</name>
Nov 30 11:09:33 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:09:33 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:09:33 user nova-compute[75020]:   <metadata>
Nov 30 11:09:33 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:09:33 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:09:33 user nova-compute[75020]:       <nova:name>tempest-TestVolumeBootPattern-server-1488346503</nova:name>
Nov 30 11:09:33 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:09:32</nova:creationTime>
Nov 30 11:09:33 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:09:33 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:09:33 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:09:33 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:09:33 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:09:33 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:09:33 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:09:33 user nova-compute[75020]:       <nova:owner>
Nov 30 11:09:33 user nova-compute[75020]:         <nova:user uuid="19afae8899f440c78b8a442361d5b531">tempest-TestVolumeBootPattern-1120216767-project-member</nova:user>
Nov 30 11:09:33 user nova-compute[75020]:         <nova:project uuid="54c52e77c7064c97bc18c9df58ae20ef">tempest-TestVolumeBootPattern-1120216767</nova:project>
Nov 30 11:09:33 user nova-compute[75020]:       </nova:owner>
Nov 30 11:09:33 user nova-compute[75020]:       <nova:ports>
Nov 30 11:09:33 user nova-compute[75020]:         <nova:port uuid="cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a">
Nov 30 11:09:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 11:09:33 user nova-compute[75020]:         </nova:port>
Nov 30 11:09:33 user nova-compute[75020]:       </nova:ports>
Nov 30 11:09:33 user nova-compute[75020]:     </nova:instance>
Nov 30 11:09:33 user nova-compute[75020]:   </metadata>
Nov 30 11:09:33 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:09:33 user nova-compute[75020]:     <system>
Nov 30 11:09:33 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:09:33 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:09:33 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:09:33 user nova-compute[75020]:       <entry name="serial">aaee883f-b87b-43c2-af7c-dfb8a7a42c05</entry>
Nov 30 11:09:33 user nova-compute[75020]:       <entry name="uuid">aaee883f-b87b-43c2-af7c-dfb8a7a42c05</entry>
Nov 30 11:09:33 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:09:33 user nova-compute[75020]:     </system>
Nov 30 11:09:33 user nova-compute[75020]:   </sysinfo>
Nov 30 11:09:33 user nova-compute[75020]:   <os>
Nov 30 11:09:33 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:09:33 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:09:33 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:09:33 user nova-compute[75020]:   </os>
Nov 30 11:09:33 user nova-compute[75020]:   <features>
Nov 30 11:09:33 user nova-compute[75020]:     <acpi/>
Nov 30 11:09:33 user nova-compute[75020]:     <apic/>
Nov 30 11:09:33 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:09:33 user nova-compute[75020]:   </features>
Nov 30 11:09:33 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:09:33 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:09:33 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:09:33 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:09:33 user nova-compute[75020]:   </clock>
Nov 30 11:09:33 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:09:33 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:09:33 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:09:33 user nova-compute[75020]:   </cpu>
Nov 30 11:09:33 user nova-compute[75020]:   <devices>
Nov 30 11:09:33 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:09:33 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:09:33 user nova-compute[75020]:       <source dev="/dev/sdb"/>
Nov 30 11:09:33 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:09:33 user nova-compute[75020]:       <serial>02160fe3-2891-461b-85c9-8a92451ef62e</serial>
Nov 30 11:09:33 user nova-compute[75020]:     </disk>
Nov 30 11:09:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:09:33 user nova-compute[75020]:       <mac address="fa:16:3e:14:6e:54"/>
Nov 30 11:09:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:09:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:09:33 user nova-compute[75020]:       <target dev="tapcc3e92cc-28"/>
Nov 30 11:09:33 user nova-compute[75020]:     </interface>
Nov 30 11:09:33 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:09:33 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/aaee883f-b87b-43c2-af7c-dfb8a7a42c05/console.log" append="off"/>
Nov 30 11:09:33 user nova-compute[75020]:     </serial>
Nov 30 11:09:33 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:09:33 user nova-compute[75020]:     <video>
Nov 30 11:09:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:09:33 user nova-compute[75020]:     </video>
Nov 30 11:09:33 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:09:33 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:09:33 user nova-compute[75020]:     </rng>
Nov 30 11:09:33 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:09:33 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:09:33 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:09:33 user nova-compute[75020]:     </memballoon>
Nov 30 11:09:33 user nova-compute[75020]:   </devices>
Nov 30 11:09:33 user nova-compute[75020]: </domain>
Nov 30 11:09:33 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1488346503',display_name='tempest-TestVolumeBootPattern-server-1488346503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1488346503',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-qlm0bc4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:09:23Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=aaee883f-b87b-43c2-af7c-dfb8a7a42c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e92cc-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG os_vif [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e92cc-28') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f612eff-d86a-5f5b-b5ca-3b0f507c04ba', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc3e92cc-28, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc3e92cc-28, col_values=(('qos', UUID('6bf3db55-aa87-4820-a6e9-d58df3e6d89e')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc3e92cc-28, col_values=(('external_ids', {'iface-id': 'cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:6e:54', 'vm-uuid': 'aaee883f-b87b-43c2-af7c-dfb8a7a42c05'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:33 user nova-compute[75020]: INFO os_vif [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e92cc-28')
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:09:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No VIF found with MAC fa:16:3e:14:6e:54, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-a3b3c93a-f9d6-45c0-a5c5-5307f79c6e1d req-43dd31e1-ba96-4560-83df-b7462e3dce40 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a3b3c93a-f9d6-45c0-a5c5-5307f79c6e1d req-43dd31e1-ba96-4560-83df-b7462e3dce40 service nova] Acquiring lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a3b3c93a-f9d6-45c0-a5c5-5307f79c6e1d req-43dd31e1-ba96-4560-83df-b7462e3dce40 service nova] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a3b3c93a-f9d6-45c0-a5c5-5307f79c6e1d req-43dd31e1-ba96-4560-83df-b7462e3dce40 service nova] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-a3b3c93a-f9d6-45c0-a5c5-5307f79c6e1d req-43dd31e1-ba96-4560-83df-b7462e3dce40 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] No waiting events found dispatching network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:09:35 user nova-compute[75020]: WARNING nova.compute.manager [req-a3b3c93a-f9d6-45c0-a5c5-5307f79c6e1d req-43dd31e1-ba96-4560-83df-b7462e3dce40 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received unexpected event network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a for instance with vm_state building and task_state spawning.
Nov 30 11:09:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:09:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Instance spawned successfully.
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:09:37 user nova-compute[75020]: INFO nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-46f6fae8-893f-4032-8f30-6ac751a82568 req-fc01535d-3bca-4111-9dfe-e129a4179dfe service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-46f6fae8-893f-4032-8f30-6ac751a82568 req-fc01535d-3bca-4111-9dfe-e129a4179dfe service nova] Acquiring lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-46f6fae8-893f-4032-8f30-6ac751a82568 req-fc01535d-3bca-4111-9dfe-e129a4179dfe service nova] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-46f6fae8-893f-4032-8f30-6ac751a82568 req-fc01535d-3bca-4111-9dfe-e129a4179dfe service nova] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-46f6fae8-893f-4032-8f30-6ac751a82568 req-fc01535d-3bca-4111-9dfe-e129a4179dfe service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] No waiting events found dispatching network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:09:37 user nova-compute[75020]: WARNING nova.compute.manager [req-46f6fae8-893f-4032-8f30-6ac751a82568 req-fc01535d-3bca-4111-9dfe-e129a4179dfe service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received unexpected event network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a for instance with vm_state building and task_state spawning.
Nov 30 11:09:37 user nova-compute[75020]: INFO nova.compute.manager [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Took 14.98 seconds to build instance.
Nov 30 11:09:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-97779aa1-17b8-40e8-93d1-9658d9e58d65 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.066s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:43 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 is timed out.
Nov 30 11:09:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Successfully detached device vdb from instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 from the live domain config.
Nov 30 11:09:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDuXrJnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:09:43 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:09:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7107d03c-48ec-401c-b11f-cdca159311a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:09:43 user nova-compute[75020]: No targets found.
Nov 30 11:09:43 user nova-compute[75020]: iSNS:
Nov 30 11:09:43 user nova-compute[75020]: No targets found.
Nov 30 11:09:43 user nova-compute[75020]: STATIC:
Nov 30 11:09:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9
Nov 30 11:09:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:09:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:09:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:09:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:09:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:09:43 user nova-compute[75020]: FIRMWARE:
Nov 30 11:09:43 user nova-compute[75020]: No targets found.
Nov 30 11:09:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:09:43 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:09:43 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.045s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e295afa2-0893-4b73-9134-b6970bc52615]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0af746-0354-4d7c-b699-960bcfa89d62]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:09:44 user nova-compute[75020]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:09:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 (non-flash)
Nov 30 11:09:44 user nova-compute[75020]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:09:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadc3731750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4eea20-3ecb-4add-ae30-9bb815c85955]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[24775575-3b9e-4717-8e8c-90a99f8107d1]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0815ec4b-6ddd-41a5-9016-e6d95b1e7a22]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f526d0-df12-4cb8-82d8-838e01bd9c03]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39869c1-228d-400c-a287-73bdff6e62ef]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[185a4ad5-f6d4-4f4f-a33f-aec54fd40d65]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9, portal: 172.16.0.220,3260]
Nov 30 11:09:44 user nova-compute[75020]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9, portal: 172.16.0.220,3260] successful.
Nov 30 11:09:44 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79b492c-9689-4b8c-b9b1-8365250b90f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ffd7b-89eb-43d9-9b49-97b9638228e5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] <== disconnect_volume: return (412ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:09:44 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:09:45 user nova-compute[75020]: DEBUG nova.objects.instance [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'flavor' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:09:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-76dbb080-145c-4dd2-80e4-76de895e74a2 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.997s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:09:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:09:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:09:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:09:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:09:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-ad7fe9da-78fc-4fb3-9ffa-a38bc556fcba req-d18fea92-e49d-4e8f-b563-8730619b336b service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-changed-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-ad7fe9da-78fc-4fb3-9ffa-a38bc556fcba req-d18fea92-e49d-4e8f-b563-8730619b336b service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Refreshing instance network info cache due to event network-changed-503a9796-e188-4a72-a429-df54ae6acc01. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ad7fe9da-78fc-4fb3-9ffa-a38bc556fcba req-d18fea92-e49d-4e8f-b563-8730619b336b service nova] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ad7fe9da-78fc-4fb3-9ffa-a38bc556fcba req-d18fea92-e49d-4e8f-b563-8730619b336b service nova] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG nova.network.neutron [req-ad7fe9da-78fc-4fb3-9ffa-a38bc556fcba req-d18fea92-e49d-4e8f-b563-8730619b336b service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Refreshing network info cache for port 503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG nova.network.neutron [req-ad7fe9da-78fc-4fb3-9ffa-a38bc556fcba req-d18fea92-e49d-4e8f-b563-8730619b336b service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updated VIF entry in instance network info cache for port 503a9796-e188-4a72-a429-df54ae6acc01. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG nova.network.neutron [req-ad7fe9da-78fc-4fb3-9ffa-a38bc556fcba req-d18fea92-e49d-4e8f-b563-8730619b336b service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ad7fe9da-78fc-4fb3-9ffa-a38bc556fcba req-d18fea92-e49d-4e8f-b563-8730619b336b service nova] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:09:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:09:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:09:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:09:57 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:09:57 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [{"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:09:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:09:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:09:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:01 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:10:01 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:10:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8336MB free_disk=24.531150817871094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:10:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance aaee883f-b87b-43c2-af7c-dfb8a7a42c05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:10:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:10:05 user nova-compute[75020]: INFO nova.compute.claims [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Claim successful on node user
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:10:05 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.policy [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e26bab64764c4697bc01cf6ac0b6b8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e6289c12e4cc4a4eceb1fb34af2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:10:05 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Creating image(s)
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "/opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "/opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk 1073741824" returned: 0 in 0.059s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Successfully created port: 0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.188s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Cannot resize image /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Ensure instance console log exists: /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.neutron [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Successfully updated port: 0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquired lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.neutron [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-9245f498-2ab5-46a2-8e22-480c93e5f4e2 req-505ab92f-a2de-4934-b1eb-937118a7313b service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received event network-changed-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.compute.manager [req-9245f498-2ab5-46a2-8e22-480c93e5f4e2 req-505ab92f-a2de-4934-b1eb-937118a7313b service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Refreshing instance network info cache due to event network-changed-0e3a5195-46e7-4e86-8eab-7d63d548463e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9245f498-2ab5-46a2-8e22-480c93e5f4e2 req-505ab92f-a2de-4934-b1eb-937118a7313b service nova] Acquiring lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.neutron [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.neutron [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Updating instance_info_cache with network_info: [{"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Releasing lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Instance network_info: |[{"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9245f498-2ab5-46a2-8e22-480c93e5f4e2 req-505ab92f-a2de-4934-b1eb-937118a7313b service nova] Acquired lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.neutron [req-9245f498-2ab5-46a2-8e22-480c93e5f4e2 req-505ab92f-a2de-4934-b1eb-937118a7313b service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Refreshing network info cache for port 0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Start _get_guest_xml network_info=[{"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:10:07 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:10:07 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1592259394',display_name='tempest-VolumesSnapshotTestJSON-instance-1592259394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1592259394',id=40,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKu2whvtl4onvUtQpLtc8XYi2k90KzKXzJMu7vpGGjtBuuzA2W8WAJqbB+PSq4ShzDL6TwhxeNWgYTGtRs708C+hZPQvhyTJ3UC1sP9Un56DA7QSGHAzrO65yLUm/oka1Q==',key_name='tempest-keypair-1042096782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d6e6289c12e4cc4a4eceb1fb34af2f0',ramdisk_id='',reservation_id='r-cwgxw3zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2088929526',owner_user_name='tempest-VolumesSnapshotTestJSON-2088929526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26bab64764c4697bc01cf6ac0b6b8dc',uuid=ca9b8df9-6807-453b-9681-ef10a7686189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converting VIF {"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:18:79,bridge_name='br-int',has_traffic_filtering=True,id=0e3a5195-46e7-4e86-8eab-7d63d548463e,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3a5195-46') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'pci_devices' on Instance uuid ca9b8df9-6807-453b-9681-ef10a7686189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:10:07 user nova-compute[75020]:   <uuid>ca9b8df9-6807-453b-9681-ef10a7686189</uuid>
Nov 30 11:10:07 user nova-compute[75020]:   <name>instance-00000028</name>
Nov 30 11:10:07 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:10:07 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:10:07 user nova-compute[75020]:   <metadata>
Nov 30 11:10:07 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:10:07 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:10:07 user nova-compute[75020]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1592259394</nova:name>
Nov 30 11:10:07 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:10:07</nova:creationTime>
Nov 30 11:10:07 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:10:07 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:10:07 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:10:07 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:10:07 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:10:07 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:10:07 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:10:07 user nova-compute[75020]:       <nova:owner>
Nov 30 11:10:07 user nova-compute[75020]:         <nova:user uuid="e26bab64764c4697bc01cf6ac0b6b8dc">tempest-VolumesSnapshotTestJSON-2088929526-project-member</nova:user>
Nov 30 11:10:07 user nova-compute[75020]:         <nova:project uuid="8d6e6289c12e4cc4a4eceb1fb34af2f0">tempest-VolumesSnapshotTestJSON-2088929526</nova:project>
Nov 30 11:10:07 user nova-compute[75020]:       </nova:owner>
Nov 30 11:10:07 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:10:07 user nova-compute[75020]:       <nova:ports>
Nov 30 11:10:07 user nova-compute[75020]:         <nova:port uuid="0e3a5195-46e7-4e86-8eab-7d63d548463e">
Nov 30 11:10:07 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 11:10:07 user nova-compute[75020]:         </nova:port>
Nov 30 11:10:07 user nova-compute[75020]:       </nova:ports>
Nov 30 11:10:07 user nova-compute[75020]:     </nova:instance>
Nov 30 11:10:07 user nova-compute[75020]:   </metadata>
Nov 30 11:10:07 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:10:07 user nova-compute[75020]:     <system>
Nov 30 11:10:07 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:10:07 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:10:07 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:10:07 user nova-compute[75020]:       <entry name="serial">ca9b8df9-6807-453b-9681-ef10a7686189</entry>
Nov 30 11:10:07 user nova-compute[75020]:       <entry name="uuid">ca9b8df9-6807-453b-9681-ef10a7686189</entry>
Nov 30 11:10:07 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:10:07 user nova-compute[75020]:     </system>
Nov 30 11:10:07 user nova-compute[75020]:   </sysinfo>
Nov 30 11:10:07 user nova-compute[75020]:   <os>
Nov 30 11:10:07 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:10:07 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:10:07 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:10:07 user nova-compute[75020]:   </os>
Nov 30 11:10:07 user nova-compute[75020]:   <features>
Nov 30 11:10:07 user nova-compute[75020]:     <acpi/>
Nov 30 11:10:07 user nova-compute[75020]:     <apic/>
Nov 30 11:10:07 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:10:07 user nova-compute[75020]:   </features>
Nov 30 11:10:07 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:10:07 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:10:07 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:10:07 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:10:07 user nova-compute[75020]:   </clock>
Nov 30 11:10:07 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:10:07 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:10:07 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:10:07 user nova-compute[75020]:   </cpu>
Nov 30 11:10:07 user nova-compute[75020]:   <devices>
Nov 30 11:10:07 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:10:07 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:10:07 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk"/>
Nov 30 11:10:07 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:10:07 user nova-compute[75020]:     </disk>
Nov 30 11:10:07 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:10:07 user nova-compute[75020]:       <mac address="fa:16:3e:d7:18:79"/>
Nov 30 11:10:07 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:10:07 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:10:07 user nova-compute[75020]:       <target dev="tap0e3a5195-46"/>
Nov 30 11:10:07 user nova-compute[75020]:     </interface>
Nov 30 11:10:07 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:10:07 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/console.log" append="off"/>
Nov 30 11:10:07 user nova-compute[75020]:     </serial>
Nov 30 11:10:07 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:10:07 user nova-compute[75020]:     <video>
Nov 30 11:10:07 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:10:07 user nova-compute[75020]:     </video>
Nov 30 11:10:07 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:10:07 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:10:07 user nova-compute[75020]:     </rng>
Nov 30 11:10:07 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:10:07 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:10:07 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:10:07 user nova-compute[75020]:     </memballoon>
Nov 30 11:10:07 user nova-compute[75020]:   </devices>
Nov 30 11:10:07 user nova-compute[75020]: </domain>
Nov 30 11:10:07 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1592259394',display_name='tempest-VolumesSnapshotTestJSON-instance-1592259394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1592259394',id=40,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKu2whvtl4onvUtQpLtc8XYi2k90KzKXzJMu7vpGGjtBuuzA2W8WAJqbB+PSq4ShzDL6TwhxeNWgYTGtRs708C+hZPQvhyTJ3UC1sP9Un56DA7QSGHAzrO65yLUm/oka1Q==',key_name='tempest-keypair-1042096782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d6e6289c12e4cc4a4eceb1fb34af2f0',ramdisk_id='',reservation_id='r-cwgxw3zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2088929526',owner_user_name='tempest-VolumesSnapshotTestJSON-2088929526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26bab64764c4697bc01cf6ac0b6b8dc',uuid=ca9b8df9-6807-453b-9681-ef10a7686189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converting VIF {"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:18:79,bridge_name='br-int',has_traffic_filtering=True,id=0e3a5195-46e7-4e86-8eab-7d63d548463e,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3a5195-46') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG os_vif [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:18:79,bridge_name='br-int',has_traffic_filtering=True,id=0e3a5195-46e7-4e86-8eab-7d63d548463e,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3a5195-46') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3eaf82d5-2b33-5e6e-8569-8d4d0a3c4bfc', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e3a5195-46, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e3a5195-46, col_values=(('qos', UUID('8b9a6a56-119a-46d0-b1b4-873f856790cd')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e3a5195-46, col_values=(('external_ids', {'iface-id': '0e3a5195-46e7-4e86-8eab-7d63d548463e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:18:79', 'vm-uuid': 'ca9b8df9-6807-453b-9681-ef10a7686189'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:07 user nova-compute[75020]: INFO os_vif [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:18:79,bridge_name='br-int',has_traffic_filtering=True,id=0e3a5195-46e7-4e86-8eab-7d63d548463e,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3a5195-46')
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No VIF found with MAC fa:16:3e:d7:18:79, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.neutron [req-9245f498-2ab5-46a2-8e22-480c93e5f4e2 req-505ab92f-a2de-4934-b1eb-937118a7313b service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Updated VIF entry in instance network info cache for port 0e3a5195-46e7-4e86-8eab-7d63d548463e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG nova.network.neutron [req-9245f498-2ab5-46a2-8e22-480c93e5f4e2 req-505ab92f-a2de-4934-b1eb-937118a7313b service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Updating instance_info_cache with network_info: [{"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:10:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9245f498-2ab5-46a2-8e22-480c93e5f4e2 req-505ab92f-a2de-4934-b1eb-937118a7313b service nova] Releasing lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-a0ae9947-5392-46e3-9692-da9153cd9195 req-d5024a6f-760e-443a-baba-95e1ef4408f8 service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received event network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a0ae9947-5392-46e3-9692-da9153cd9195 req-d5024a6f-760e-443a-baba-95e1ef4408f8 service nova] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a0ae9947-5392-46e3-9692-da9153cd9195 req-d5024a6f-760e-443a-baba-95e1ef4408f8 service nova] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a0ae9947-5392-46e3-9692-da9153cd9195 req-d5024a6f-760e-443a-baba-95e1ef4408f8 service nova] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-a0ae9947-5392-46e3-9692-da9153cd9195 req-d5024a6f-760e-443a-baba-95e1ef4408f8 service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] No waiting events found dispatching network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:10:09 user nova-compute[75020]: WARNING nova.compute.manager [req-a0ae9947-5392-46e3-9692-da9153cd9195 req-d5024a6f-760e-443a-baba-95e1ef4408f8 service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received unexpected event network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e for instance with vm_state building and task_state spawning.
Nov 30 11:10:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb5d0396-eac9-4418-a065-8fa9000c3f0f req-29c4401f-c23e-49b8-a34b-4956ca4b963b service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received event network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb5d0396-eac9-4418-a065-8fa9000c3f0f req-29c4401f-c23e-49b8-a34b-4956ca4b963b service nova] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb5d0396-eac9-4418-a065-8fa9000c3f0f req-29c4401f-c23e-49b8-a34b-4956ca4b963b service nova] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb5d0396-eac9-4418-a065-8fa9000c3f0f req-29c4401f-c23e-49b8-a34b-4956ca4b963b service nova] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb5d0396-eac9-4418-a065-8fa9000c3f0f req-29c4401f-c23e-49b8-a34b-4956ca4b963b service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] No waiting events found dispatching network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:10:11 user nova-compute[75020]: WARNING nova.compute.manager [req-eb5d0396-eac9-4418-a065-8fa9000c3f0f req-29c4401f-c23e-49b8-a34b-4956ca4b963b service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received unexpected event network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e for instance with vm_state building and task_state spawning.
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:10:11 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Instance spawned successfully.
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:11 user nova-compute[75020]: INFO nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 30 11:10:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:10:11 user nova-compute[75020]: INFO nova.compute.manager [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Took 6.45 seconds to build instance.
Nov 30 11:10:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb144004-d705-4421-b59f-0716d4818db9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.563s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:13 user nova-compute[75020]: INFO nova.compute.manager [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Terminating instance
Nov 30 11:10:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:10:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-aeaa3505-ee45-4f76-a1e5-e42deca9caf8 req-d23e06c2-fea7-47c9-8235-dc58bcc702b4 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-aeaa3505-ee45-4f76-a1e5-e42deca9caf8 req-d23e06c2-fea7-47c9-8235-dc58bcc702b4 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-aeaa3505-ee45-4f76-a1e5-e42deca9caf8 req-d23e06c2-fea7-47c9-8235-dc58bcc702b4 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-aeaa3505-ee45-4f76-a1e5-e42deca9caf8 req-d23e06c2-fea7-47c9-8235-dc58bcc702b4 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-aeaa3505-ee45-4f76-a1e5-e42deca9caf8 req-d23e06c2-fea7-47c9-8235-dc58bcc702b4 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-aeaa3505-ee45-4f76-a1e5-e42deca9caf8 req-d23e06c2-fea7-47c9-8235-dc58bcc702b4 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-unplugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Instance destroyed successfully.
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.objects.instance [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'resources' on Instance uuid d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2071756196',display_name='tempest-ServerRescueNegativeTestJSON-server-2071756196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2071756196',id=33,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuXk83Zzd7VusNvBjcbhIiGlQNKPBpumulr0zlrDK2/TWLgAPCvxATdCN65Fgva4S1jzF8fUTozTYSKQtaF6MDusWOL6TRQRk22LbSWdYxFuNqD7I4ecZDouVEay4u5kw==',key_name='tempest-keypair-251013875',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:05:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-auym15az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "903ec885-1189-4bde-be19-0d7cabee638e", "address": "fa:16:3e:34:c2:c8", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ec885-11", "ovs_interfaceid": "903ec885-1189-4bde-be19-0d7cabee638e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:c2:c8,bridge_name='br-int',has_traffic_filtering=True,id=903ec885-1189-4bde-be19-0d7cabee638e,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903ec885-11') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG os_vif [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:c2:c8,bridge_name='br-int',has_traffic_filtering=True,id=903ec885-1189-4bde-be19-0d7cabee638e,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903ec885-11') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903ec885-11, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=525df4c9-9196-439c-a30b-dbcd60d3c59a) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: INFO os_vif [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:c2:c8,bridge_name='br-int',has_traffic_filtering=True,id=903ec885-1189-4bde-be19-0d7cabee638e,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903ec885-11')
Nov 30 11:10:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Deleting instance files /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466_del
Nov 30 11:10:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Deletion of /opt/stack/data/nova/instances/d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466_del complete
Nov 30 11:10:14 user nova-compute[75020]: INFO nova.compute.manager [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 30 11:10:14 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:15 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:10:15 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Took 0.96 seconds to deallocate network for instance.
Nov 30 11:10:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:15 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:10:15 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:10:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:15 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Deleted allocations for instance d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466
Nov 30 11:10:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7423fc33-4c96-42be-b5f3-a1f79124ab06 tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-4202becc-9198-487b-9ee8-886b91ca948a req-afd1671f-f767-4eb2-b5fa-8e9e1f262dc7 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4202becc-9198-487b-9ee8-886b91ca948a req-afd1671f-f767-4eb2-b5fa-8e9e1f262dc7 service nova] Acquiring lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4202becc-9198-487b-9ee8-886b91ca948a req-afd1671f-f767-4eb2-b5fa-8e9e1f262dc7 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4202becc-9198-487b-9ee8-886b91ca948a req-afd1671f-f767-4eb2-b5fa-8e9e1f262dc7 service nova] Lock "d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-4202becc-9198-487b-9ee8-886b91ca948a req-afd1671f-f767-4eb2-b5fa-8e9e1f262dc7 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] No waiting events found dispatching network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:10:16 user nova-compute[75020]: WARNING nova.compute.manager [req-4202becc-9198-487b-9ee8-886b91ca948a req-afd1671f-f767-4eb2-b5fa-8e9e1f262dc7 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received unexpected event network-vif-plugged-903ec885-1189-4bde-be19-0d7cabee638e for instance with vm_state deleted and task_state None.
Nov 30 11:10:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-4202becc-9198-487b-9ee8-886b91ca948a req-afd1671f-f767-4eb2-b5fa-8e9e1f262dc7 service nova] [instance: d4eb9c1e-1f01-4d7a-a42a-edd5c5b4e466] Received event network-vif-deleted-903ec885-1189-4bde-be19-0d7cabee638e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:10:30 user nova-compute[75020]: INFO nova.compute.claims [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Claim successful on node user
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:10:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.policy [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c45cc9328084164b4b43638befb99b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a5d7100ace4533afcf8877c324688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:10:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Creating image(s)
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "/opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "/opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.207s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk 1073741824" returned: 0 in 0.055s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Successfully created port: 6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Cannot resize image /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Ensure instance console log exists: /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Successfully updated port: 6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-346079d5-baab-44e7-bc7f-2255ddb267bf req-7ba2d0f5-9a3d-43d5-8650-8c5e4d7dfa43 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Received event network-changed-6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-346079d5-baab-44e7-bc7f-2255ddb267bf req-7ba2d0f5-9a3d-43d5-8650-8c5e4d7dfa43 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Refreshing instance network info cache due to event network-changed-6b79ea84-f3be-4da0-bf26-8a626036a38f. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-346079d5-baab-44e7-bc7f-2255ddb267bf req-7ba2d0f5-9a3d-43d5-8650-8c5e4d7dfa43 service nova] Acquiring lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-346079d5-baab-44e7-bc7f-2255ddb267bf req-7ba2d0f5-9a3d-43d5-8650-8c5e4d7dfa43 service nova] Acquired lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-346079d5-baab-44e7-bc7f-2255ddb267bf req-7ba2d0f5-9a3d-43d5-8650-8c5e4d7dfa43 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Refreshing network info cache for port 6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:10:31 user nova-compute[75020]: DEBUG nova.network.neutron [req-346079d5-baab-44e7-bc7f-2255ddb267bf req-7ba2d0f5-9a3d-43d5-8650-8c5e4d7dfa43 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.network.neutron [req-346079d5-baab-44e7-bc7f-2255ddb267bf req-7ba2d0f5-9a3d-43d5-8650-8c5e4d7dfa43 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-346079d5-baab-44e7-bc7f-2255ddb267bf req-7ba2d0f5-9a3d-43d5-8650-8c5e4d7dfa43 service nova] Releasing lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquired lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Updating instance_info_cache with network_info: [{"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Releasing lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Instance network_info: |[{"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Start _get_guest_xml network_info=[{"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:10:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:10:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-544609355',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-544609355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5446093',id=41,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLKFZNWWpUtiTd+t8tqdlHb9CV7L9bVvV5bW4VFZzUOR4eJow2nofGGZEnfXZOHY2N1ZFtRzmYV0OrqiyBWTBk7IcCibgm37q8NvntdX7fldTBZdrbP7JaIzqBnggbcxA==',key_name='tempest-keypair-698969879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a5d7100ace4533afcf8877c324688f',ramdisk_id='',reservation_id='r-63ib9vdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-728025175',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c45cc9328084164b4b43638befb99b9',uuid=6fc77719-49fc-45e3-9d3e-7b3f92fd2afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Converting VIF {"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=6b79ea84-f3be-4da0-bf26-8a626036a38f,network=Network(b9988213-f707-4b4b-bd67-65c412f286fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b79ea84-f3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:10:32 user nova-compute[75020]:   <uuid>6fc77719-49fc-45e3-9d3e-7b3f92fd2afd</uuid>
Nov 30 11:10:32 user nova-compute[75020]:   <name>instance-00000029</name>
Nov 30 11:10:32 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:10:32 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:10:32 user nova-compute[75020]:   <metadata>
Nov 30 11:10:32 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:10:32 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:10:32 user nova-compute[75020]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-544609355</nova:name>
Nov 30 11:10:32 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:10:32</nova:creationTime>
Nov 30 11:10:32 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:10:32 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:10:32 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:10:32 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:10:32 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:10:32 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:10:32 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:10:32 user nova-compute[75020]:       <nova:owner>
Nov 30 11:10:32 user nova-compute[75020]:         <nova:user uuid="1c45cc9328084164b4b43638befb99b9">tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member</nova:user>
Nov 30 11:10:32 user nova-compute[75020]:         <nova:project uuid="69a5d7100ace4533afcf8877c324688f">tempest-TestServerVolumeAttachScenarioOldVersion-728025175</nova:project>
Nov 30 11:10:32 user nova-compute[75020]:       </nova:owner>
Nov 30 11:10:32 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:10:32 user nova-compute[75020]:       <nova:ports>
Nov 30 11:10:32 user nova-compute[75020]:         <nova:port uuid="6b79ea84-f3be-4da0-bf26-8a626036a38f">
Nov 30 11:10:32 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 11:10:32 user nova-compute[75020]:         </nova:port>
Nov 30 11:10:32 user nova-compute[75020]:       </nova:ports>
Nov 30 11:10:32 user nova-compute[75020]:     </nova:instance>
Nov 30 11:10:32 user nova-compute[75020]:   </metadata>
Nov 30 11:10:32 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:10:32 user nova-compute[75020]:     <system>
Nov 30 11:10:32 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:10:32 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:10:32 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:10:32 user nova-compute[75020]:       <entry name="serial">6fc77719-49fc-45e3-9d3e-7b3f92fd2afd</entry>
Nov 30 11:10:32 user nova-compute[75020]:       <entry name="uuid">6fc77719-49fc-45e3-9d3e-7b3f92fd2afd</entry>
Nov 30 11:10:32 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:10:32 user nova-compute[75020]:     </system>
Nov 30 11:10:32 user nova-compute[75020]:   </sysinfo>
Nov 30 11:10:32 user nova-compute[75020]:   <os>
Nov 30 11:10:32 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:10:32 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:10:32 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:10:32 user nova-compute[75020]:   </os>
Nov 30 11:10:32 user nova-compute[75020]:   <features>
Nov 30 11:10:32 user nova-compute[75020]:     <acpi/>
Nov 30 11:10:32 user nova-compute[75020]:     <apic/>
Nov 30 11:10:32 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:10:32 user nova-compute[75020]:   </features>
Nov 30 11:10:32 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:10:32 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:10:32 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:10:32 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:10:32 user nova-compute[75020]:   </clock>
Nov 30 11:10:32 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:10:32 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:10:32 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:10:32 user nova-compute[75020]:   </cpu>
Nov 30 11:10:32 user nova-compute[75020]:   <devices>
Nov 30 11:10:32 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:10:32 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:10:32 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk"/>
Nov 30 11:10:32 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:10:32 user nova-compute[75020]:     </disk>
Nov 30 11:10:32 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:10:32 user nova-compute[75020]:       <mac address="fa:16:3e:b2:cc:fb"/>
Nov 30 11:10:32 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:10:32 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:10:32 user nova-compute[75020]:       <target dev="tap6b79ea84-f3"/>
Nov 30 11:10:32 user nova-compute[75020]:     </interface>
Nov 30 11:10:32 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:10:32 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/console.log" append="off"/>
Nov 30 11:10:32 user nova-compute[75020]:     </serial>
Nov 30 11:10:32 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:10:32 user nova-compute[75020]:     <video>
Nov 30 11:10:32 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:10:32 user nova-compute[75020]:     </video>
Nov 30 11:10:32 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:10:32 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:10:32 user nova-compute[75020]:     </rng>
Nov 30 11:10:32 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:10:32 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:10:32 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:10:32 user nova-compute[75020]:     </memballoon>
Nov 30 11:10:32 user nova-compute[75020]:   </devices>
Nov 30 11:10:32 user nova-compute[75020]: </domain>
Nov 30 11:10:32 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-544609355',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-544609355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5446093',id=41,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLKFZNWWpUtiTd+t8tqdlHb9CV7L9bVvV5bW4VFZzUOR4eJow2nofGGZEnfXZOHY2N1ZFtRzmYV0OrqiyBWTBk7IcCibgm37q8NvntdX7fldTBZdrbP7JaIzqBnggbcxA==',key_name='tempest-keypair-698969879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a5d7100ace4533afcf8877c324688f',ramdisk_id='',reservation_id='r-63ib9vdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-728025175',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c45cc9328084164b4b43638befb99b9',uuid=6fc77719-49fc-45e3-9d3e-7b3f92fd2afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Converting VIF {"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=6b79ea84-f3be-4da0-bf26-8a626036a38f,network=Network(b9988213-f707-4b4b-bd67-65c412f286fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b79ea84-f3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG os_vif [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=6b79ea84-f3be-4da0-bf26-8a626036a38f,network=Network(b9988213-f707-4b4b-bd67-65c412f286fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b79ea84-f3') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5b33939-998a-5304-bb25-b7e5d098fb8a', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b79ea84-f3, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b79ea84-f3, col_values=(('qos', UUID('4dec77e3-f982-410f-87c4-c48bec3d1232')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b79ea84-f3, col_values=(('external_ids', {'iface-id': '6b79ea84-f3be-4da0-bf26-8a626036a38f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:cc:fb', 'vm-uuid': '6fc77719-49fc-45e3-9d3e-7b3f92fd2afd'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:32 user nova-compute[75020]: INFO os_vif [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=6b79ea84-f3be-4da0-bf26-8a626036a38f,network=Network(b9988213-f707-4b4b-bd67-65c412f286fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b79ea84-f3')
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:10:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] No VIF found with MAC fa:16:3e:b2:cc:fb, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-f83dca70-a3d5-4740-acbe-293cc7fca960 req-62a0b755-7481-41c9-9500-3bd7ea772f82 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Received event network-vif-plugged-6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f83dca70-a3d5-4740-acbe-293cc7fca960 req-62a0b755-7481-41c9-9500-3bd7ea772f82 service nova] Acquiring lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f83dca70-a3d5-4740-acbe-293cc7fca960 req-62a0b755-7481-41c9-9500-3bd7ea772f82 service nova] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f83dca70-a3d5-4740-acbe-293cc7fca960 req-62a0b755-7481-41c9-9500-3bd7ea772f82 service nova] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-f83dca70-a3d5-4740-acbe-293cc7fca960 req-62a0b755-7481-41c9-9500-3bd7ea772f82 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] No waiting events found dispatching network-vif-plugged-6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:10:34 user nova-compute[75020]: WARNING nova.compute.manager [req-f83dca70-a3d5-4740-acbe-293cc7fca960 req-62a0b755-7481-41c9-9500-3bd7ea772f82 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Received unexpected event network-vif-plugged-6b79ea84-f3be-4da0-bf26-8a626036a38f for instance with vm_state building and task_state spawning.
Nov 30 11:10:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:10:36 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Instance spawned successfully.
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:10:36 user nova-compute[75020]: INFO nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:10:36 user nova-compute[75020]: INFO nova.compute.manager [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Took 6.08 seconds to build instance.
Nov 30 11:10:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8f82913b-58dd-4f8c-92a0-9333bdea3505 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.424s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-5b79481d-5b9f-4318-8062-e670c1890447 req-954afda9-56cc-4c48-a3dd-0b323c363454 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Received event network-vif-plugged-6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5b79481d-5b9f-4318-8062-e670c1890447 req-954afda9-56cc-4c48-a3dd-0b323c363454 service nova] Acquiring lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5b79481d-5b9f-4318-8062-e670c1890447 req-954afda9-56cc-4c48-a3dd-0b323c363454 service nova] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5b79481d-5b9f-4318-8062-e670c1890447 req-954afda9-56cc-4c48-a3dd-0b323c363454 service nova] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-5b79481d-5b9f-4318-8062-e670c1890447 req-954afda9-56cc-4c48-a3dd-0b323c363454 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] No waiting events found dispatching network-vif-plugged-6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:10:36 user nova-compute[75020]: WARNING nova.compute.manager [req-5b79481d-5b9f-4318-8062-e670c1890447 req-954afda9-56cc-4c48-a3dd-0b323c363454 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Received unexpected event network-vif-plugged-6b79ea84-f3be-4da0-bf26-8a626036a38f for instance with vm_state active and task_state None.
Nov 30 11:10:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:10:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:54 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:10:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:10:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:10:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:01 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:11:01 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:11:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8223MB free_disk=25.14630126953125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:11:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance aaee883f-b87b-43c2-af7c-dfb8a7a42c05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance ca9b8df9-6807-453b-9681-ef10a7686189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:11:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:13 user nova-compute[75020]: INFO nova.compute.manager [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Terminating instance
Nov 30 11:11:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:11:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb2b10c9-26a4-4f71-ae16-e2a1a4b747b7 req-897d958c-f0cc-4fac-b228-3eca46244263 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-changed-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb2b10c9-26a4-4f71-ae16-e2a1a4b747b7 req-897d958c-f0cc-4fac-b228-3eca46244263 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Refreshing instance network info cache due to event network-changed-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb2b10c9-26a4-4f71-ae16-e2a1a4b747b7 req-897d958c-f0cc-4fac-b228-3eca46244263 service nova] Acquiring lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb2b10c9-26a4-4f71-ae16-e2a1a4b747b7 req-897d958c-f0cc-4fac-b228-3eca46244263 service nova] Acquired lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-eb2b10c9-26a4-4f71-ae16-e2a1a4b747b7 req-897d958c-f0cc-4fac-b228-3eca46244263 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Refreshing network info cache for port cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:11:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Instance destroyed successfully.
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'resources' on Instance uuid a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-236943404',display_name='tempest-ServerRescueNegativeTestJSON-server-236943404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-236943404',id=21,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:56:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-8q4lqc6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T10:57:00Z,user_data=None,user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "b32faceb-68a8-41a0-bb9c-8323823298aa", "address": "fa:16:3e:36:6e:06", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32faceb-68", "ovs_interfaceid": "b32faceb-68a8-41a0-bb9c-8323823298aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=b32faceb-68a8-41a0-bb9c-8323823298aa,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32faceb-68') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG os_vif [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=b32faceb-68a8-41a0-bb9c-8323823298aa,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32faceb-68') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb32faceb-68, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7871e621-c20d-44cb-84a2-77b5fb05232b) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:14 user nova-compute[75020]: INFO os_vif [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=b32faceb-68a8-41a0-bb9c-8323823298aa,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32faceb-68')
Nov 30 11:11:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Deleting instance files /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f_del
Nov 30 11:11:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Deletion of /opt/stack/data/nova/instances/a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f_del complete
Nov 30 11:11:14 user nova-compute[75020]: INFO nova.compute.manager [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 30 11:11:14 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-eb2b10c9-26a4-4f71-ae16-e2a1a4b747b7 req-897d958c-f0cc-4fac-b228-3eca46244263 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updated VIF entry in instance network info cache for port cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:11:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-eb2b10c9-26a4-4f71-ae16-e2a1a4b747b7 req-897d958c-f0cc-4fac-b228-3eca46244263 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updating instance_info_cache with network_info: [{"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:11:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb2b10c9-26a4-4f71-ae16-e2a1a4b747b7 req-897d958c-f0cc-4fac-b228-3eca46244263 service nova] Releasing lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:11:15 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:11:15 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Took 0.66 seconds to deallocate network for instance.
Nov 30 11:11:15 user nova-compute[75020]: DEBUG nova.compute.manager [req-91afdfed-92c2-449b-a573-22f3111979f7 req-35e48d94-2d7e-4ec9-a4fa-0ce9dfd22b36 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-deleted-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:11:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:15 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:11:15 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:11:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:15 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Deleted allocations for instance a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f
Nov 30 11:11:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c73eec60-9937-4529-891b-a00589729a8c tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-unplugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] No waiting events found dispatching network-vif-unplugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:11:16 user nova-compute[75020]: WARNING nova.compute.manager [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received unexpected event network-vif-unplugged-b32faceb-68a8-41a0-bb9c-8323823298aa for instance with vm_state deleted and task_state None.
Nov 30 11:11:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] Acquiring lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] Lock "a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] No waiting events found dispatching network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:11:16 user nova-compute[75020]: WARNING nova.compute.manager [req-bdcd343b-4ba7-4f50-9100-81b82dde0235 req-3f8dcc88-527e-46b8-acbd-7df1cc0a96b5 service nova] [instance: a9d5bbb8-2dc4-4a70-b64a-aabf6f3c1e2f] Received unexpected event network-vif-plugged-b32faceb-68a8-41a0-bb9c-8323823298aa for instance with vm_state deleted and task_state None.
Nov 30 11:11:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:11:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:22 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:11:22 user nova-compute[75020]: INFO nova.compute.claims [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Claim successful on node user
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:11:23 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.policy [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19afae8899f440c78b8a442361d5b531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c52e77c7064c97bc18c9df58ae20ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:11:23 user nova-compute[75020]: INFO nova.virt.block_device [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Booting with volume 5dab0510-b2f3-4025-97e2-075707ec3e60 at /dev/vda
Nov 30 11:11:23 user nova-compute[75020]: DEBUG os_brick.utils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f3c4df-e474-4f4c-aa11-faa4e6f07ec7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[259f33e2-ec44-455a-96cd-af0f0abe3b0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c811fb-3cab-44f0-a4d6-203258726598]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0568433e-d80d-40f1-9fbe-f8a1f65d9870]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:11:23 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:11:23 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c6afe9-da2a-47d9-8a5b-444c65cc7448]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG os_brick.utils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updating existing volume attachment record: e42c7ec2-759f-4196-8c4b-edf8d4dd47fa {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:11:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Successfully created port: f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Successfully updated port: f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquired lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-8b1f590a-feb6-4c36-b112-8ed84ca6b6fc req-7041804b-527d-4285-96d8-c0aa6b8e93ea service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-changed-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-8b1f590a-feb6-4c36-b112-8ed84ca6b6fc req-7041804b-527d-4285-96d8-c0aa6b8e93ea service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Refreshing instance network info cache due to event network-changed-f42e43ef-2367-4d69-af6d-21dde057f4bf. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8b1f590a-feb6-4c36-b112-8ed84ca6b6fc req-7041804b-527d-4285-96d8-c0aa6b8e93ea service nova] Acquiring lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG nova.network.neutron [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updating instance_info_cache with network_info: [{"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Releasing lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Instance network_info: |[{"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8b1f590a-feb6-4c36-b112-8ed84ca6b6fc req-7041804b-527d-4285-96d8-c0aa6b8e93ea service nova] Acquired lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:11:24 user nova-compute[75020]: DEBUG nova.network.neutron [req-8b1f590a-feb6-4c36-b112-8ed84ca6b6fc req-7041804b-527d-4285-96d8-c0aa6b8e93ea service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Refreshing network info cache for port f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:11:25 user nova-compute[75020]: DEBUG nova.network.neutron [req-8b1f590a-feb6-4c36-b112-8ed84ca6b6fc req-7041804b-527d-4285-96d8-c0aa6b8e93ea service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updated VIF entry in instance network info cache for port f42e43ef-2367-4d69-af6d-21dde057f4bf. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:11:25 user nova-compute[75020]: DEBUG nova.network.neutron [req-8b1f590a-feb6-4c36-b112-8ed84ca6b6fc req-7041804b-527d-4285-96d8-c0aa6b8e93ea service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updating instance_info_cache with network_info: [{"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:11:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8b1f590a-feb6-4c36-b112-8ed84ca6b6fc req-7041804b-527d-4285-96d8-c0aa6b8e93ea service nova] Releasing lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:11:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:11:32 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Creating image(s)
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Ensure instance console log exists: /opt/stack/data/nova/instances/3c4e7f7f-37ae-40c1-a77c-113c340933b9/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Start _get_guest_xml network_info=[{"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'e42c7ec2-759f-4196-8c4b-edf8d4dd47fa', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFWBxovt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c4e7f7f-37ae-40c1-a77c-113c340933b9', 'attached_at': '', 'detached_at': '', 'volume_id': '5dab0510-b2f3-4025-97e2-075707ec3e60', 'serial': '5dab0510-b2f3-4025-97e2-075707ec3e60'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:11:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:11:32 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFWBxovt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:11:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:11:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:11:32 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ae4e52-277e-4aaa-a6e6-fb23587d8357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:11:32 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[805176f0-1498-4677-8955-de5a34b8df84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60] added
Nov 30 11:11:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.102s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17ae2e9-ecd5-4f08-a2cc-e4df7034ffb6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4823417b-2623-4cbb-8b97-4b3d614abb83]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFWBxovt {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFWBxovt" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cd8a5e-2518-4c4a-a60c-b2c6adbdd29c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IFWBxovt'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cfb9c0-d3e3-4493-ad26-d15394eaa288]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb0a99-f2f8-449d-93c6-7d768b6cc1e2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:11:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:11:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c842bcf9-a025-468a-ae5a-8be3ab189099]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60, portal: 172.16.0.220,3260]
Nov 30 11:11:32 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60, portal: 172.16.0.220,3260] successful.
Nov 30 11:11:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d076b1c-6db9-4e1c-8322-e18aa90ce111]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5139d8d8-f0b9-43dc-b1bc-807a0dc18a25]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:11:32 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:11:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:11:32 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:11:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[61acb3ac-5df2-48d5-b45a-c6a00d7f30e6]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:11:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFWBxovt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23536303533313134', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536303533313134', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-490213544',display_name='tempest-TestVolumeBootPattern-server-490213544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-490213544',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-8d05h3cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:11:23Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=3c4e7f7f-37ae-40c1-a77c-113c340933b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:5e:6d,bridge_name='br-int',has_traffic_filtering=True,id=f42e43ef-2367-4d69-af6d-21dde057f4bf,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42e43ef-23') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.objects.instance [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c4e7f7f-37ae-40c1-a77c-113c340933b9 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:11:33 user nova-compute[75020]:   <uuid>3c4e7f7f-37ae-40c1-a77c-113c340933b9</uuid>
Nov 30 11:11:33 user nova-compute[75020]:   <name>instance-0000002a</name>
Nov 30 11:11:33 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:11:33 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:11:33 user nova-compute[75020]:   <metadata>
Nov 30 11:11:33 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:11:33 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:11:33 user nova-compute[75020]:       <nova:name>tempest-TestVolumeBootPattern-server-490213544</nova:name>
Nov 30 11:11:33 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:11:32</nova:creationTime>
Nov 30 11:11:33 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:11:33 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:11:33 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:11:33 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:11:33 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:11:33 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:11:33 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:11:33 user nova-compute[75020]:       <nova:owner>
Nov 30 11:11:33 user nova-compute[75020]:         <nova:user uuid="19afae8899f440c78b8a442361d5b531">tempest-TestVolumeBootPattern-1120216767-project-member</nova:user>
Nov 30 11:11:33 user nova-compute[75020]:         <nova:project uuid="54c52e77c7064c97bc18c9df58ae20ef">tempest-TestVolumeBootPattern-1120216767</nova:project>
Nov 30 11:11:33 user nova-compute[75020]:       </nova:owner>
Nov 30 11:11:33 user nova-compute[75020]:       <nova:ports>
Nov 30 11:11:33 user nova-compute[75020]:         <nova:port uuid="f42e43ef-2367-4d69-af6d-21dde057f4bf">
Nov 30 11:11:33 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 11:11:33 user nova-compute[75020]:         </nova:port>
Nov 30 11:11:33 user nova-compute[75020]:       </nova:ports>
Nov 30 11:11:33 user nova-compute[75020]:     </nova:instance>
Nov 30 11:11:33 user nova-compute[75020]:   </metadata>
Nov 30 11:11:33 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:11:33 user nova-compute[75020]:     <system>
Nov 30 11:11:33 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:11:33 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:11:33 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:11:33 user nova-compute[75020]:       <entry name="serial">3c4e7f7f-37ae-40c1-a77c-113c340933b9</entry>
Nov 30 11:11:33 user nova-compute[75020]:       <entry name="uuid">3c4e7f7f-37ae-40c1-a77c-113c340933b9</entry>
Nov 30 11:11:33 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:11:33 user nova-compute[75020]:     </system>
Nov 30 11:11:33 user nova-compute[75020]:   </sysinfo>
Nov 30 11:11:33 user nova-compute[75020]:   <os>
Nov 30 11:11:33 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:11:33 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:11:33 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:11:33 user nova-compute[75020]:   </os>
Nov 30 11:11:33 user nova-compute[75020]:   <features>
Nov 30 11:11:33 user nova-compute[75020]:     <acpi/>
Nov 30 11:11:33 user nova-compute[75020]:     <apic/>
Nov 30 11:11:33 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:11:33 user nova-compute[75020]:   </features>
Nov 30 11:11:33 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:11:33 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:11:33 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:11:33 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:11:33 user nova-compute[75020]:   </clock>
Nov 30 11:11:33 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:11:33 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:11:33 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:11:33 user nova-compute[75020]:   </cpu>
Nov 30 11:11:33 user nova-compute[75020]:   <devices>
Nov 30 11:11:33 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:11:33 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:11:33 user nova-compute[75020]:       <source dev="/dev/sdc"/>
Nov 30 11:11:33 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:11:33 user nova-compute[75020]:       <serial>5dab0510-b2f3-4025-97e2-075707ec3e60</serial>
Nov 30 11:11:33 user nova-compute[75020]:     </disk>
Nov 30 11:11:33 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:11:33 user nova-compute[75020]:       <mac address="fa:16:3e:a1:5e:6d"/>
Nov 30 11:11:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:11:33 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:11:33 user nova-compute[75020]:       <target dev="tapf42e43ef-23"/>
Nov 30 11:11:33 user nova-compute[75020]:     </interface>
Nov 30 11:11:33 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:11:33 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/3c4e7f7f-37ae-40c1-a77c-113c340933b9/console.log" append="off"/>
Nov 30 11:11:33 user nova-compute[75020]:     </serial>
Nov 30 11:11:33 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:11:33 user nova-compute[75020]:     <video>
Nov 30 11:11:33 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:11:33 user nova-compute[75020]:     </video>
Nov 30 11:11:33 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:11:33 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:11:33 user nova-compute[75020]:     </rng>
Nov 30 11:11:33 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:11:33 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:11:33 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:11:33 user nova-compute[75020]:     </memballoon>
Nov 30 11:11:33 user nova-compute[75020]:   </devices>
Nov 30 11:11:33 user nova-compute[75020]: </domain>
Nov 30 11:11:33 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-490213544',display_name='tempest-TestVolumeBootPattern-server-490213544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-490213544',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-8d05h3cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:11:23Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=3c4e7f7f-37ae-40c1-a77c-113c340933b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:5e:6d,bridge_name='br-int',has_traffic_filtering=True,id=f42e43ef-2367-4d69-af6d-21dde057f4bf,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42e43ef-23') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG os_vif [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:5e:6d,bridge_name='br-int',has_traffic_filtering=True,id=f42e43ef-2367-4d69-af6d-21dde057f4bf,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42e43ef-23') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0aa74a2-81b1-5346-bfd3-0a3462ead9ce', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf42e43ef-23, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf42e43ef-23, col_values=(('qos', UUID('2e7a5f6f-7a5e-41fc-a47d-a7516bed857b')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf42e43ef-23, col_values=(('external_ids', {'iface-id': 'f42e43ef-2367-4d69-af6d-21dde057f4bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:5e:6d', 'vm-uuid': '3c4e7f7f-37ae-40c1-a77c-113c340933b9'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:33 user nova-compute[75020]: INFO os_vif [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:5e:6d,bridge_name='br-int',has_traffic_filtering=True,id=f42e43ef-2367-4d69-af6d-21dde057f4bf,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42e43ef-23')
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:11:33 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] No VIF found with MAC fa:16:3e:a1:5e:6d, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-c79a3df5-267d-48d5-aed0-9443ddc6b4c6 req-81782248-b1f9-4d7f-aa0a-f47bde08f3d6 service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c79a3df5-267d-48d5-aed0-9443ddc6b4c6 req-81782248-b1f9-4d7f-aa0a-f47bde08f3d6 service nova] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c79a3df5-267d-48d5-aed0-9443ddc6b4c6 req-81782248-b1f9-4d7f-aa0a-f47bde08f3d6 service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c79a3df5-267d-48d5-aed0-9443ddc6b4c6 req-81782248-b1f9-4d7f-aa0a-f47bde08f3d6 service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-c79a3df5-267d-48d5-aed0-9443ddc6b4c6 req-81782248-b1f9-4d7f-aa0a-f47bde08f3d6 service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] No waiting events found dispatching network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:11:35 user nova-compute[75020]: WARNING nova.compute.manager [req-c79a3df5-267d-48d5-aed0-9443ddc6b4c6 req-81782248-b1f9-4d7f-aa0a-f47bde08f3d6 service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received unexpected event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf for instance with vm_state building and task_state spawning.
Nov 30 11:11:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:11:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Instance spawned successfully.
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:11:37 user nova-compute[75020]: INFO nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-833902c2-4510-484a-a615-c237dd4a2722 req-c47237b3-5733-4185-a8ac-76886e10ed7e service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-833902c2-4510-484a-a615-c237dd4a2722 req-c47237b3-5733-4185-a8ac-76886e10ed7e service nova] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-833902c2-4510-484a-a615-c237dd4a2722 req-c47237b3-5733-4185-a8ac-76886e10ed7e service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-833902c2-4510-484a-a615-c237dd4a2722 req-c47237b3-5733-4185-a8ac-76886e10ed7e service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-833902c2-4510-484a-a615-c237dd4a2722 req-c47237b3-5733-4185-a8ac-76886e10ed7e service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] No waiting events found dispatching network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:11:37 user nova-compute[75020]: WARNING nova.compute.manager [req-833902c2-4510-484a-a615-c237dd4a2722 req-c47237b3-5733-4185-a8ac-76886e10ed7e service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received unexpected event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf for instance with vm_state building and task_state spawning.
Nov 30 11:11:37 user nova-compute[75020]: INFO nova.compute.manager [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Took 14.41 seconds to build instance.
Nov 30 11:11:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-09738125-6555-4e95-9aca-15840e9e45e8 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.518s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lazy-loading 'flavor' on Instance uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:46 user nova-compute[75020]: INFO nova.compute.manager [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Attaching volume ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a to /dev/vdb
Nov 30 11:11:46 user nova-compute[75020]: DEBUG os_brick.utils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2985c6a3-6514-4528-9660-f96d36c7b2ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2f99dd-6893-43c6-90fb-68b1270ebebb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a1e1d0-9b8c-4f2d-8a7b-712a47985005]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9414b6e6-3a23-4cfe-8b52-2fc6258eec69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:11:46 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:11:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc87bc-dbd0-4819-8beb-a79ab123f88e]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG os_brick.utils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:11:46 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating existing volume attachment record: ef30e1bf-1f86-41b4-bb25-399da0726c6b {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:11:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:11:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:11:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:11:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:11:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:54 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:11:55 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:11:55 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:11:55 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f7f1f7-425f-4357-bf41-ac3313f7bcc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:11:55 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[567a1d89-ab8d-441b-b600-7e07b8fb113a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a] added
Nov 30 11:11:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b7b897-dfb8-4629-a1f6-8cee8b870f98]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e7bdd-d523-40e2-b2ac-13fb9ce9055c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyaULDIh {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyaULDIh" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e1b28f-acb8-4045-90ff-49c699bbe23f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fyaULDIh'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4e1ef-57d6-41bc-b214-2af102e24098]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f64685b-784a-43db-b405-63f595de7699]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:11:55 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:11:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:11:55 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:11:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --login" returned: 0 in 0.207s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7471c568-4666-424c-8df0-3c586407a978]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]
Nov 30 11:11:55 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.
Nov 30 11:11:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2308a0-bec0-495c-96f1-1082a0b33af5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77f5ff0-2a74-4caa-bd9f-40b48e2df267]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:11:55 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:11:55 user nova-compute[75020]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:11:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:11:55 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:11:55 user nova-compute[75020]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:11:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca93701d-cc67-4a19-8b2b-a354952a07c9]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:11:55 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-0cd02dbc-81fc-4d8b-9b05-81e9768cbe4b req-e41b3278-2b42-47f6-bdb3-5128f16bb2ab service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received event network-changed-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-0cd02dbc-81fc-4d8b-9b05-81e9768cbe4b req-e41b3278-2b42-47f6-bdb3-5128f16bb2ab service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Refreshing instance network info cache due to event network-changed-0e3a5195-46e7-4e86-8eab-7d63d548463e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0cd02dbc-81fc-4d8b-9b05-81e9768cbe4b req-e41b3278-2b42-47f6-bdb3-5128f16bb2ab service nova] Acquiring lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0cd02dbc-81fc-4d8b-9b05-81e9768cbe4b req-e41b3278-2b42-47f6-bdb3-5128f16bb2ab service nova] Acquired lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.network.neutron [req-0cd02dbc-81fc-4d8b-9b05-81e9768cbe4b req-e41b3278-2b42-47f6-bdb3-5128f16bb2ab service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Refreshing network info cache for port 0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'flavor' on Instance uuid ca9b8df9-6807-453b-9681-ef10a7686189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:11:56 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Ignoring supplied device name: /dev/vdb
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26235396463373734', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235396463373734', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lazy-loading 'flavor' on Instance uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:11:56 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:11:56 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 11:11:56 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:11:56 user nova-compute[75020]:   <serial>ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a</serial>
Nov 30 11:11:56 user nova-compute[75020]: </disk>
Nov 30 11:11:56 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:56 user nova-compute[75020]: INFO nova.compute.manager [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Attaching volume 125975f7-9dc1-4128-ace9-e596a9b20c74 to /dev/vdb
Nov 30 11:11:56 user nova-compute[75020]: DEBUG os_brick.utils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b376ed9c-cbd2-45ed-8fe4-b12512ed59e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77942d1-9b75-40af-aaf0-a6806ddecab2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.network.neutron [req-0cd02dbc-81fc-4d8b-9b05-81e9768cbe4b req-e41b3278-2b42-47f6-bdb3-5128f16bb2ab service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Updated VIF entry in instance network info cache for port 0e3a5195-46e7-4e86-8eab-7d63d548463e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.network.neutron [req-0cd02dbc-81fc-4d8b-9b05-81e9768cbe4b req-e41b3278-2b42-47f6-bdb3-5128f16bb2ab service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Updating instance_info_cache with network_info: [{"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1517d757-42e1-488f-86f4-a6a169a37b37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4c0b34-fe71-4835-8dbb-0d447267cd86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0cd02dbc-81fc-4d8b-9b05-81e9768cbe4b req-e41b3278-2b42-47f6-bdb3-5128f16bb2ab service nova] Releasing lock "refresh_cache-ca9b8df9-6807-453b-9681-ef10a7686189" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:11:56 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:11:56 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75de96d-1504-4dce-8574-e2065e07468a]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG os_brick.utils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:11:56 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Updating existing volume attachment record: 393d4c4e-735a-4713-ad15-defed0105112 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:11:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:11:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:11:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] No VIF found with MAC fa:16:3e:4b:ea:b1, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:11:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cdf33060-b934-48db-b208-f78f9a5c1319 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.961s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updating instance_info_cache with network_info: [{"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-13d43551-5590-4e96-a197-fe2556e080c5" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:11:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:11:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Stashing vm_state: active {{(pid=75020) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:12:00 user nova-compute[75020]: INFO nova.compute.claims [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Claim successful on node user
Nov 30 11:12:00 user nova-compute[75020]: INFO nova.compute.resource_tracker [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating resource usage from migration c080f242-c927-4ffe-84ed-e4dfe3bcbe47
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.414s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:00 user nova-compute[75020]: INFO nova.compute.manager [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Migrating
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG nova.network.neutron [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:12:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:12:01 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:12:01 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8294MB free_disk=25.163864135742188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Applying migration context for instance edfaac3a-50a5-4b24-881e-cb5a6baedbae as it has an incoming, in-progress migration c080f242-c927-4ffe-84ed-e4dfe3bcbe47. Migration status is pre-migrating {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 11:12:01 user nova-compute[75020]: INFO nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating resource usage from migration c080f242-c927-4ffe-84ed-e4dfe3bcbe47
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 13d43551-5590-4e96-a197-fe2556e080c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance aaee883f-b87b-43c2-af7c-dfb8a7a42c05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance ca9b8df9-6807-453b-9681-ef10a7686189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 3c4e7f7f-37ae-40c1-a77c-113c340933b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Migration c080f242-c927-4ffe-84ed-e4dfe3bcbe47 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.network.neutron [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Starting migrate_disk_and_power_off {{(pid=75020) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-66c88202-37d1-4dd7-ba3f-cd331154f6cb req-57de6887-b185-4bb8-a5e0-5e1ce6635f89 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-66c88202-37d1-4dd7-ba3f-cd331154f6cb req-57de6887-b185-4bb8-a5e0-5e1ce6635f89 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-66c88202-37d1-4dd7-ba3f-cd331154f6cb req-57de6887-b185-4bb8-a5e0-5e1ce6635f89 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-66c88202-37d1-4dd7-ba3f-cd331154f6cb req-57de6887-b185-4bb8-a5e0-5e1ce6635f89 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-66c88202-37d1-4dd7-ba3f-cd331154f6cb req-57de6887-b185-4bb8-a5e0-5e1ce6635f89 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:12:01 user nova-compute[75020]: WARNING nova.compute.manager [req-66c88202-37d1-4dd7-ba3f-cd331154f6cb req-57de6887-b185-4bb8-a5e0-5e1ce6635f89 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state active and task_state resize_migrating.
Nov 30 11:12:02 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance destroyed successfully.
Nov 30 11:12:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:08:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:12:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1223602415-network", "vif_mac": "fa:16:3e:4b:ea:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1223602415-network", "vif_mac": "fa:16:3e:4b:ea:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_vif [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap503a9796-e1, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=328b1d88-fd45-496b-bb80-15c1e731c3b7) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:02 user nova-compute[75020]: INFO os_vif [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1')
Nov 30 11:12:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:12:02 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c6a70-2537-4f0c-9f30-7f0d6db86c19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:12:02 user nova-compute[75020]: No targets found.
Nov 30 11:12:02 user nova-compute[75020]: iSNS:
Nov 30 11:12:02 user nova-compute[75020]: No targets found.
Nov 30 11:12:02 user nova-compute[75020]: STATIC:
Nov 30 11:12:02 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:12:02 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:02 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:02 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:12:02 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:02 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:02 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60
Nov 30 11:12:02 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:02 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:02 user nova-compute[75020]: FIRMWARE:
Nov 30 11:12:02 user nova-compute[75020]: No targets found.
Nov 30 11:12:02 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:12:02 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:12:02 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c2d610-d9a1-4bdd-9245-0fd1007c710e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a7c2e4-1123-4132-b36a-1a5112bb2139]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:02 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:02 user nova-compute[75020]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:02 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:02 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:02 user nova-compute[75020]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:02 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88600160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a'): ({'sdd'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Removing single pathed devices sdd {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e5d161-65c9-4145-b0e9-c9f5ae4fe74f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62ecf51-59d8-4933-a2ff-96dde6efa2dc]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flushing IO for device /dev/sdd {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[baabbf78-0498-4a20-a182-c65ee1a33ba5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe8ceea-a02c-44ef-a7a0-d5d74c1c523a]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af9dd07-e7a9-499f-a6db-cd4049f5a553]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0ef101-3afc-472a-bd79-19c306ef6373]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]
Nov 30 11:12:02 user nova-compute[75020]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.
Nov 30 11:12:02 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7b07e-17d4-4591-93f0-05acde5d0a53]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== disconnect_volume: return (308ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:12:02 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae_resize/disk /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "cp -r /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae_resize/disk /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk" returned: 0 in 0.384s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae_resize/disk.info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk.info {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "cp -r /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae_resize/disk.info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk.info" returned: 0 in 0.034s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-b722cb63-22f1-45d5-b0db-f2190243e612 req-e3218512-db64-4d77-a7fe-9a5c5d14cbd6 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b722cb63-22f1-45d5-b0db-f2190243e612 req-e3218512-db64-4d77-a7fe-9a5c5d14cbd6 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b722cb63-22f1-45d5-b0db-f2190243e612 req-e3218512-db64-4d77-a7fe-9a5c5d14cbd6 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b722cb63-22f1-45d5-b0db-f2190243e612 req-e3218512-db64-4d77-a7fe-9a5c5d14cbd6 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:03 user nova-compute[75020]: DEBUG nova.compute.manager [req-b722cb63-22f1-45d5-b0db-f2190243e612 req-e3218512-db64-4d77-a7fe-9a5c5d14cbd6 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:12:03 user nova-compute[75020]: WARNING nova.compute.manager [req-b722cb63-22f1-45d5-b0db-f2190243e612 req-e3218512-db64-4d77-a7fe-9a5c5d14cbd6 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state active and task_state resize_migrating.
Nov 30 11:12:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG nova.network.neutron [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Port 503a9796-e188-4a72-a429-df54ae6acc01 binding to destination host user is already ACTIVE {{(pid=75020) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "13d43551-5590-4e96-a197-fe2556e080c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:04 user nova-compute[75020]: INFO nova.compute.manager [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Terminating instance
Nov 30 11:12:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG nova.network.neutron [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-da718c83-002e-4eac-809e-3bb537e24e39 req-8b609570-99e9-47e7-94c9-f4727314cd54 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-da718c83-002e-4eac-809e-3bb537e24e39 req-8b609570-99e9-47e7-94c9-f4727314cd54 service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-da718c83-002e-4eac-809e-3bb537e24e39 req-8b609570-99e9-47e7-94c9-f4727314cd54 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-da718c83-002e-4eac-809e-3bb537e24e39 req-8b609570-99e9-47e7-94c9-f4727314cd54 service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-da718c83-002e-4eac-809e-3bb537e24e39 req-8b609570-99e9-47e7-94c9-f4727314cd54 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:12:04 user nova-compute[75020]: DEBUG nova.compute.manager [req-da718c83-002e-4eac-809e-3bb537e24e39 req-8b609570-99e9-47e7-94c9-f4727314cd54 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-unplugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:12:05 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Instance destroyed successfully.
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.objects.instance [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lazy-loading 'resources' on Instance uuid 13d43551-5590-4e96-a197-fe2556e080c5 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T10:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1477575849',display_name='tempest-ServerRescueNegativeTestJSON-server-1477575849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1477575849',id=20,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T10:59:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f16bf7c990e4b7c945642594b58584e',ramdisk_id='',reservation_id='r-206orr2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2071093195',owner_user_name='tempest-ServerRescueNegativeTestJSON-2071093195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:01:44Z,user_data=None,user_id='2cee10a54cf845a6a328df4e9ea4be85',uuid=13d43551-5590-4e96-a197-fe2556e080c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converting VIF {"id": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "address": "fa:16:3e:58:45:1d", "network": {"id": "9f82de46-d7d1-4d6d-bb3b-70efeb481174", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1059488107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f16bf7c990e4b7c945642594b58584e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape987d4f5-0e", "ovs_interfaceid": "e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:45:1d,bridge_name='br-int',has_traffic_filtering=True,id=e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape987d4f5-0e') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG os_vif [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:45:1d,bridge_name='br-int',has_traffic_filtering=True,id=e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape987d4f5-0e') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape987d4f5-0e, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cf256fa-4cd0-48ce-9370-ef61f6ddf85b) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:12:05 user nova-compute[75020]: INFO os_vif [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:45:1d,bridge_name='br-int',has_traffic_filtering=True,id=e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0,network=Network(9f82de46-d7d1-4d6d-bb3b-70efeb481174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape987d4f5-0e')
Nov 30 11:12:05 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Deleting instance files /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5_del
Nov 30 11:12:05 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Deletion of /opt/stack/data/nova/instances/13d43551-5590-4e96-a197-fe2556e080c5_del complete
Nov 30 11:12:05 user nova-compute[75020]: DEBUG os_brick.utils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff66f6e-009a-4f7e-8b3e-fbda309a1070]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f495c68-c16a-4cc3-bafc-e61d3062f700]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a15beb-ade6-4e4a-8ad8-05953d1d5d42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c362acb-5d0c-4e81-a30b-30f7d3bd946a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:12:05 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae5d734-77e4-46e6-aa71-7ea8576c575f]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG os_brick.utils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:12:05 user nova-compute[75020]: INFO nova.compute.manager [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 30 11:12:05 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:12:05 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:12:06 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Took 0.68 seconds to deallocate network for instance.
Nov 30 11:12:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-ef901bc3-17d2-4eff-8973-abf07ee4ff6e req-3d7249dc-3660-4744-a5ca-2fa9935d82e5 service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-deleted-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNdmfRUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:12:06 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:06 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:06 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7bf471-f3c2-45a6-bbcc-dfc7cad94b48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:12:06 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e2b4a1-1f7b-4e7e-abe1-ca0ae473b305]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74] added
Nov 30 11:12:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c336a9-b961-4fa4-a0cc-d19473540e68]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4d1264-fbe7-4150-8aa9-c8c595fbcb16]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lNdmfRUJ {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lNdmfRUJ" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5b391-3c20-4df1-91d6-2fba73bc9754]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lNdmfRUJ'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b7ca2-7251-40ed-985e-a87f5817e716]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df6f822-1c61-47e6-858f-1e861b879c0c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:06 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:06 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Deleted allocations for instance 13d43551-5590-4e96-a197-fe2556e080c5
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[613c1c39-b888-460a-9389-96bfaa4ca5e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74, portal: 172.16.0.220,3260]
Nov 30 11:12:06 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74, portal: 172.16.0.220,3260] successful.
Nov 30 11:12:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1cfb69-b3ef-4f24-b496-b9fe595f15f6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc79df7-052a-495f-9248-90fd856d6ab2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:06 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:06 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:06 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:06 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-953472ed-1e1e-49ec-badb-a67b5d54df7d tempest-ServerRescueNegativeTestJSON-2071093195 tempest-ServerRescueNegativeTestJSON-2071093195-project-member] Lock "13d43551-5590-4e96-a197-fe2556e080c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.184s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16a02b1-a8a5-4597-ba1d-0769b03d2924]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-ba17c57e-9c26-4030-ac98-64ac18c9f3e4 req-25feff30-8615-4d09-98a9-f7f2bced801c service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ba17c57e-9c26-4030-ac98-64ac18c9f3e4 req-25feff30-8615-4d09-98a9-f7f2bced801c service nova] Acquiring lock "13d43551-5590-4e96-a197-fe2556e080c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ba17c57e-9c26-4030-ac98-64ac18c9f3e4 req-25feff30-8615-4d09-98a9-f7f2bced801c service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ba17c57e-9c26-4030-ac98-64ac18c9f3e4 req-25feff30-8615-4d09-98a9-f7f2bced801c service nova] Lock "13d43551-5590-4e96-a197-fe2556e080c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-ba17c57e-9c26-4030-ac98-64ac18c9f3e4 req-25feff30-8615-4d09-98a9-f7f2bced801c service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] No waiting events found dispatching network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:12:06 user nova-compute[75020]: WARNING nova.compute.manager [req-ba17c57e-9c26-4030-ac98-64ac18c9f3e4 req-25feff30-8615-4d09-98a9-f7f2bced801c service nova] [instance: 13d43551-5590-4e96-a197-fe2556e080c5] Received unexpected event network-vif-plugged-e987d4f5-0eb5-4ac7-ac1b-a9c426579ff0 for instance with vm_state deleted and task_state None.
Nov 30 11:12:06 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNdmfRUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23335636239633439', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335636239633439', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG nova.objects.instance [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'flavor' on Instance uuid ca9b8df9-6807-453b-9681-ef10a7686189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:12:07 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:12:07 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 11:12:07 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:12:07 user nova-compute[75020]:   <serial>125975f7-9dc1-4128-ace9-e596a9b20c74</serial>
Nov 30 11:12:07 user nova-compute[75020]: </disk>
Nov 30 11:12:07 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:12:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No VIF found with MAC fa:16:3e:d7:18:79, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:12:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-909ef6f5-8855-4455-b82e-cc562d5b8cf8 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.422s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Starting finish_migration {{(pid=75020) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance directory exists: not creating {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 11:12:14 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Creating image(s)
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk. size=21474836480 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk 21474836480 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk 21474836480" returned: 0 in 0.046s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Ensure instance console log exists: /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Start _get_guest_xml network_info=[{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1223602415-network", "vif_mac": "fa:16:3e:4b:ea:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '4d87fa01-f080-4a70-a9ac-547e2a57d0cd', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'edfaac3a-50a5-4b24-881e-cb5a6baedbae', 'attached_at': '2023-11-30T11:12:14.000000', 'detached_at': '', 'volume_id': 'ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'serial': 'ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:12:15 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:12:15 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:12:15 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:15 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:15 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bf8a76-b0c6-4010-bd8c-58e10cd38d25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:12:15 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3032c853-2b4a-42cb-9a63-e6c319ea260c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a] added
Nov 30 11:12:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed11ee-645e-4162-8063-5b806b797bf1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff72a93-66e5-490c-abb4-912c5cb64727]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyaULDIh {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyaULDIh" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5013e1-e254-4afd-afc7-e89eee7ba718]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fyaULDIh'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9689e3e-75ce-435b-83c2-69cd728ffd35]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6bf1d9-fe45-4553-bc83-4524d6ee7611]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d424dcf-0638-4156-9dfa-a6e06adf242a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]
Nov 30 11:12:15 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.
Nov 30 11:12:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c1b3e6-b145-4593-bc53-2b2f6c855ab1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4b30a4-d1a0-4164-b8c7-f6e2a1187bd6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:15 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:15 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a04cb4-46be-4687-99e8-bef397d6b9fc]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:15 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26235396463373734', 'path': '/dev/sde'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235396463373734', 'path': '/dev/sde'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:08:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1223602415-network", "vif_mac": "fa:16:3e:4b:ea:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1223602415-network", "vif_mac": "fa:16:3e:4b:ea:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:12:16 user nova-compute[75020]:   <uuid>edfaac3a-50a5-4b24-881e-cb5a6baedbae</uuid>
Nov 30 11:12:16 user nova-compute[75020]:   <name>instance-00000026</name>
Nov 30 11:12:16 user nova-compute[75020]:   <memory>2097152</memory>
Nov 30 11:12:16 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:12:16 user nova-compute[75020]:   <metadata>
Nov 30 11:12:16 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:12:16 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:12:16 user nova-compute[75020]:       <nova:name>tempest-ServerActionsTestOtherB-server-1598589341</nova:name>
Nov 30 11:12:16 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:12:15</nova:creationTime>
Nov 30 11:12:16 user nova-compute[75020]:       <nova:flavor name="m1.small">
Nov 30 11:12:16 user nova-compute[75020]:         <nova:memory>2048</nova:memory>
Nov 30 11:12:16 user nova-compute[75020]:         <nova:disk>20</nova:disk>
Nov 30 11:12:16 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:12:16 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:12:16 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:12:16 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:12:16 user nova-compute[75020]:       <nova:owner>
Nov 30 11:12:16 user nova-compute[75020]:         <nova:user uuid="5a5d2305e8d346009c88bb5324446309">tempest-ServerActionsTestOtherB-561456809-project-member</nova:user>
Nov 30 11:12:16 user nova-compute[75020]:         <nova:project uuid="f399c3a5bd2d4acf815b09df902f226c">tempest-ServerActionsTestOtherB-561456809</nova:project>
Nov 30 11:12:16 user nova-compute[75020]:       </nova:owner>
Nov 30 11:12:16 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:12:16 user nova-compute[75020]:       <nova:ports>
Nov 30 11:12:16 user nova-compute[75020]:         <nova:port uuid="503a9796-e188-4a72-a429-df54ae6acc01">
Nov 30 11:12:16 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 11:12:16 user nova-compute[75020]:         </nova:port>
Nov 30 11:12:16 user nova-compute[75020]:       </nova:ports>
Nov 30 11:12:16 user nova-compute[75020]:     </nova:instance>
Nov 30 11:12:16 user nova-compute[75020]:   </metadata>
Nov 30 11:12:16 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:12:16 user nova-compute[75020]:     <system>
Nov 30 11:12:16 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:12:16 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:12:16 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:12:16 user nova-compute[75020]:       <entry name="serial">edfaac3a-50a5-4b24-881e-cb5a6baedbae</entry>
Nov 30 11:12:16 user nova-compute[75020]:       <entry name="uuid">edfaac3a-50a5-4b24-881e-cb5a6baedbae</entry>
Nov 30 11:12:16 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:12:16 user nova-compute[75020]:     </system>
Nov 30 11:12:16 user nova-compute[75020]:   </sysinfo>
Nov 30 11:12:16 user nova-compute[75020]:   <os>
Nov 30 11:12:16 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:12:16 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:12:16 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:12:16 user nova-compute[75020]:   </os>
Nov 30 11:12:16 user nova-compute[75020]:   <features>
Nov 30 11:12:16 user nova-compute[75020]:     <acpi/>
Nov 30 11:12:16 user nova-compute[75020]:     <apic/>
Nov 30 11:12:16 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:12:16 user nova-compute[75020]:   </features>
Nov 30 11:12:16 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:12:16 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:12:16 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:12:16 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:12:16 user nova-compute[75020]:   </clock>
Nov 30 11:12:16 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:12:16 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:12:16 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:12:16 user nova-compute[75020]:   </cpu>
Nov 30 11:12:16 user nova-compute[75020]:   <devices>
Nov 30 11:12:16 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:12:16 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:12:16 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk"/>
Nov 30 11:12:16 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:12:16 user nova-compute[75020]:     </disk>
Nov 30 11:12:16 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:12:16 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:12:16 user nova-compute[75020]:       <source dev="/dev/sde"/>
Nov 30 11:12:16 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 11:12:16 user nova-compute[75020]:       <serial>ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a</serial>
Nov 30 11:12:16 user nova-compute[75020]:     </disk>
Nov 30 11:12:16 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:12:16 user nova-compute[75020]:       <mac address="fa:16:3e:4b:ea:b1"/>
Nov 30 11:12:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:12:16 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:12:16 user nova-compute[75020]:       <target dev="tap503a9796-e1"/>
Nov 30 11:12:16 user nova-compute[75020]:     </interface>
Nov 30 11:12:16 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:12:16 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/console.log" append="off"/>
Nov 30 11:12:16 user nova-compute[75020]:     </serial>
Nov 30 11:12:16 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:12:16 user nova-compute[75020]:     <video>
Nov 30 11:12:16 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:12:16 user nova-compute[75020]:     </video>
Nov 30 11:12:16 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:12:16 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:12:16 user nova-compute[75020]:     </rng>
Nov 30 11:12:16 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:12:16 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:12:16 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:12:16 user nova-compute[75020]:     </memballoon>
Nov 30 11:12:16 user nova-compute[75020]:   </devices>
Nov 30 11:12:16 user nova-compute[75020]: </domain>
Nov 30 11:12:16 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:08:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1223602415-network", "vif_mac": "fa:16:3e:4b:ea:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1223602415-network", "vif_mac": "fa:16:3e:4b:ea:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG os_vif [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eab15340-2dc3-5550-928c-2770e56a2345', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap503a9796-e1, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap503a9796-e1, col_values=(('qos', UUID('f0d78080-6164-41fa-9ea7-f124f27725be')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap503a9796-e1, col_values=(('external_ids', {'iface-id': '503a9796-e188-4a72-a429-df54ae6acc01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:ea:b1', 'vm-uuid': 'edfaac3a-50a5-4b24-881e-cb5a6baedbae'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:16 user nova-compute[75020]: INFO os_vif [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1')
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:12:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] No VIF found with MAC fa:16:3e:4b:ea:b1, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:12:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-4b44d640-380d-403f-9788-3def6dbc10ee req-7888af39-408a-4a57-8a9a-87658f2170df service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4b44d640-380d-403f-9788-3def6dbc10ee req-7888af39-408a-4a57-8a9a-87658f2170df service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4b44d640-380d-403f-9788-3def6dbc10ee req-7888af39-408a-4a57-8a9a-87658f2170df service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4b44d640-380d-403f-9788-3def6dbc10ee req-7888af39-408a-4a57-8a9a-87658f2170df service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-4b44d640-380d-403f-9788-3def6dbc10ee req-7888af39-408a-4a57-8a9a-87658f2170df service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:12:17 user nova-compute[75020]: WARNING nova.compute.manager [req-4b44d640-380d-403f-9788-3def6dbc10ee req-7888af39-408a-4a57-8a9a-87658f2170df service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state active and task_state resize_finish.
Nov 30 11:12:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:12:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance running successfully.
Nov 30 11:12:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Failed to set time: agent not configured {{(pid=75020) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 11:12:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-831c0b9a-8806-4c12-82de-1586eb73a544 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] finish_migration finished successfully. {{(pid=75020) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 30 11:12:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-ad5adea9-9e16-41f8-8e2c-27754c823a1b req-dd59daba-d89e-4ed9-890f-81a43fd15f53 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ad5adea9-9e16-41f8-8e2c-27754c823a1b req-dd59daba-d89e-4ed9-890f-81a43fd15f53 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ad5adea9-9e16-41f8-8e2c-27754c823a1b req-dd59daba-d89e-4ed9-890f-81a43fd15f53 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ad5adea9-9e16-41f8-8e2c-27754c823a1b req-dd59daba-d89e-4ed9-890f-81a43fd15f53 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:20 user nova-compute[75020]: DEBUG nova.compute.manager [req-ad5adea9-9e16-41f8-8e2c-27754c823a1b req-dd59daba-d89e-4ed9-890f-81a43fd15f53 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:12:20 user nova-compute[75020]: WARNING nova.compute.manager [req-ad5adea9-9e16-41f8-8e2c-27754c823a1b req-dd59daba-d89e-4ed9-890f-81a43fd15f53 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state active and task_state resize_finish.
Nov 30 11:12:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-ccba1536-91bb-4422-a22e-7e289b7767a6 req-9834ef82-1805-441b-8b17-12a2b9c3e9a5 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Received event network-changed-6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-ccba1536-91bb-4422-a22e-7e289b7767a6 req-9834ef82-1805-441b-8b17-12a2b9c3e9a5 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Refreshing instance network info cache due to event network-changed-6b79ea84-f3be-4da0-bf26-8a626036a38f. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:12:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ccba1536-91bb-4422-a22e-7e289b7767a6 req-9834ef82-1805-441b-8b17-12a2b9c3e9a5 service nova] Acquiring lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:12:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ccba1536-91bb-4422-a22e-7e289b7767a6 req-9834ef82-1805-441b-8b17-12a2b9c3e9a5 service nova] Acquired lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:12:21 user nova-compute[75020]: DEBUG nova.network.neutron [req-ccba1536-91bb-4422-a22e-7e289b7767a6 req-9834ef82-1805-441b-8b17-12a2b9c3e9a5 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Refreshing network info cache for port 6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:12:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-ccba1536-91bb-4422-a22e-7e289b7767a6 req-9834ef82-1805-441b-8b17-12a2b9c3e9a5 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Updated VIF entry in instance network info cache for port 6b79ea84-f3be-4da0-bf26-8a626036a38f. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:12:22 user nova-compute[75020]: DEBUG nova.network.neutron [req-ccba1536-91bb-4422-a22e-7e289b7767a6 req-9834ef82-1805-441b-8b17-12a2b9c3e9a5 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Updating instance_info_cache with network_info: [{"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:12:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ccba1536-91bb-4422-a22e-7e289b7767a6 req-9834ef82-1805-441b-8b17-12a2b9c3e9a5 service nova] Releasing lock "refresh_cache-6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:12:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG nova.objects.instance [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lazy-loading 'flavor' on Instance uuid 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:26 user nova-compute[75020]: INFO nova.compute.manager [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Attaching volume d7856a60-963d-4f14-bc3c-0942a222b715 to /dev/vdb
Nov 30 11:12:26 user nova-compute[75020]: DEBUG os_brick.utils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d9e9be-e345-4d5e-b89b-41e861d4893d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba429f81-5639-4324-8e30-8bff40d1e366]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad9c67d-5a03-46fc-aac5-7cf9beeaf5db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f997618-394c-4af2-b672-06335a766155]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:12:26 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:12:26 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462b24f-40db-4116-a121-210b200358b0]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG os_brick.utils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:12:26 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Updating existing volume attachment record: 8d5b52e1-a490-4b02-bafb-2ad9e02600e6 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:12:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:34 user nova-compute[75020]: INFO nova.compute.manager [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Detaching volume 125975f7-9dc1-4128-ace9-e596a9b20c74
Nov 30 11:12:34 user nova-compute[75020]: INFO nova.virt.block_device [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Attempting to driver detach volume 125975f7-9dc1-4128-ace9-e596a9b20c74 from mountpoint /dev/vdb
Nov 30 11:12:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Attempting to detach device vdb from instance ca9b8df9-6807-453b-9681-ef10a7686189 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:12:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:12:34 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:12:34 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 11:12:34 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:12:34 user nova-compute[75020]:   <serial>125975f7-9dc1-4128-ace9-e596a9b20c74</serial>
Nov 30 11:12:34 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:12:34 user nova-compute[75020]: </disk>
Nov 30 11:12:34 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:12:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Successfully detached device vdb from instance ca9b8df9-6807-453b-9681-ef10a7686189 from the persistent domain config.
Nov 30 11:12:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca9b8df9-6807-453b-9681-ef10a7686189 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:12:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:12:34 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:12:34 user nova-compute[75020]:   <source dev="/dev/sdd"/>
Nov 30 11:12:34 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:12:34 user nova-compute[75020]:   <serial>125975f7-9dc1-4128-ace9-e596a9b20c74</serial>
Nov 30 11:12:34 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:12:34 user nova-compute[75020]: </disk>
Nov 30 11:12:34 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:12:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca9b8df9-6807-453b-9681-ef10a7686189 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWARtsuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:12:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:36 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[44de8572-e3ed-4693-9b9d-78966ba84afc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:12:36 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecd67c7-e4aa-43b8-bc23-6975eccfd26b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715] added
Nov 30 11:12:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1947d3f5-7f86-42fe-ad2a-378fba58db6c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[02008ef7-22fa-4d7e-96f9-d3fbc49b5efc]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWARtsuC {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWARtsuC" returned: 0 in 0.032s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff51c95b-c81c-413b-9baf-10f2620e0642]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MWARtsuC'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[85def8a6-8ae7-449a-9f0b-e80c8103135c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[097f31cd-a81d-4bb0-97f9-e0467fcb2947]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6032140f-aae3-4c27-9163-68d6baa113d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715, portal: 172.16.0.220,3260]
Nov 30 11:12:36 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715, portal: 172.16.0.220,3260] successful.
Nov 30 11:12:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2910d0b-bcf4-4cb1-badf-3a8641c935bb]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.101s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e5465d-abc7-455f-9832-f195e558a92d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:36 user nova-compute[75020]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)
Nov 30 11:12:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[80de5a4d-4b13-4975-8e22-e4864e893380]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:12:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWARtsuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:12:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '26166393332316361', 'path': '/dev/sdf'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:12:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166393332316361', 'path': '/dev/sdf'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:12:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lazy-loading 'flavor' on Instance uuid 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:12:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:12:37 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:12:37 user nova-compute[75020]:   <source dev="/dev/sdf"/>
Nov 30 11:12:37 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:12:37 user nova-compute[75020]:   <serial>d7856a60-963d-4f14-bc3c-0942a222b715</serial>
Nov 30 11:12:37 user nova-compute[75020]: </disk>
Nov 30 11:12:37 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:12:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:12:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:12:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] No VIF found with MAC fa:16:3e:b2:cc:fb, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:12:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3f6823f1-2ada-4934-976c-135898640f16 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.530s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:40 user nova-compute[75020]: INFO nova.compute.manager [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Detaching volume d7856a60-963d-4f14-bc3c-0942a222b715
Nov 30 11:12:40 user nova-compute[75020]: INFO nova.virt.block_device [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Attempting to driver detach volume d7856a60-963d-4f14-bc3c-0942a222b715 from mountpoint /dev/vdb
Nov 30 11:12:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Attempting to detach device vdb from instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:12:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:12:40 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:12:40 user nova-compute[75020]:   <source dev="/dev/sdf"/>
Nov 30 11:12:40 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:12:40 user nova-compute[75020]:   <serial>d7856a60-963d-4f14-bc3c-0942a222b715</serial>
Nov 30 11:12:40 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:12:40 user nova-compute[75020]: </disk>
Nov 30 11:12:40 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:12:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Successfully detached device vdb from instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd from the persistent domain config.
Nov 30 11:12:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:12:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:12:40 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:12:40 user nova-compute[75020]:   <source dev="/dev/sdf"/>
Nov 30 11:12:40 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:12:40 user nova-compute[75020]:   <serial>d7856a60-963d-4f14-bc3c-0942a222b715</serial>
Nov 30 11:12:40 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:12:40 user nova-compute[75020]: </disk>
Nov 30 11:12:40 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:12:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:12:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:54 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ca9b8df9-6807-453b-9681-ef10a7686189 is timed out.
Nov 30 11:12:54 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Successfully detached device vdb from instance ca9b8df9-6807-453b-9681-ef10a7686189 from the live domain config.
Nov 30 11:12:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNdmfRUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:12:54 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd85b520-a193-4709-b2df-424a1e9dc898]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:12:54 user nova-compute[75020]: No targets found.
Nov 30 11:12:54 user nova-compute[75020]: iSNS:
Nov 30 11:12:54 user nova-compute[75020]: No targets found.
Nov 30 11:12:54 user nova-compute[75020]: STATIC:
Nov 30 11:12:54 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:12:54 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:54 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:54 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:12:54 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:54 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:54 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74
Nov 30 11:12:54 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:54 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:54 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60
Nov 30 11:12:54 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:54 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:54 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715
Nov 30 11:12:54 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:54 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:54 user nova-compute[75020]: FIRMWARE:
Nov 30 11:12:54 user nova-compute[75020]: No targets found.
Nov 30 11:12:54 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:12:54 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:12:54 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f41103-4f2a-4cfe-8001-57e2512b42f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a3e95c-c001-46e0-b8d6-99a2fb9dfcf3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:54 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:54 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:54 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:54 user nova-compute[75020]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)
Nov 30 11:12:54 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:54 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:54 user nova-compute[75020]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 (non-flash)
Nov 30 11:12:54 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:54 user nova-compute[75020]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)
Nov 30 11:12:54 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88603b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74'): ({'sdd'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Removing single pathed devices sdd {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b80900c-8373-4f48-8a30-8371d44cd49c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[469096f1-f6c0-47a4-9cb0-90784d6060e4]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Flushing IO for device /dev/sdd {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e0705b-7dd5-4949-a0ed-9ef74583d850]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:12:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e45d187-044e-46c3-b9bb-0550b609a818]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a917804-6fe4-4b3e-a03f-d512b32edbea]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccd2a2c-1adf-4f34-8d8b-49e146c09676]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74, portal: 172.16.0.220,3260]
Nov 30 11:12:55 user nova-compute[75020]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74, portal: 172.16.0.220,3260] successful.
Nov 30 11:12:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[156cc460-8712-463b-85e7-1e176dbe3431]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] <== disconnect_volume: return (347ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:55 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'flavor' on Instance uuid ca9b8df9-6807-453b-9681-ef10a7686189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-289bec1c-206a-45c5-817e-7ad335c89a1d tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.050s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.905s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:56 user nova-compute[75020]: INFO nova.compute.manager [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Terminating instance
Nov 30 11:12:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-9790c32e-d1b2-4dd1-bd09-1beaf02ffb44 req-0c32be88-8926-4466-8ba2-f7838290c1aa service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received event network-vif-unplugged-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9790c32e-d1b2-4dd1-bd09-1beaf02ffb44 req-0c32be88-8926-4466-8ba2-f7838290c1aa service nova] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9790c32e-d1b2-4dd1-bd09-1beaf02ffb44 req-0c32be88-8926-4466-8ba2-f7838290c1aa service nova] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9790c32e-d1b2-4dd1-bd09-1beaf02ffb44 req-0c32be88-8926-4466-8ba2-f7838290c1aa service nova] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-9790c32e-d1b2-4dd1-bd09-1beaf02ffb44 req-0c32be88-8926-4466-8ba2-f7838290c1aa service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] No waiting events found dispatching network-vif-unplugged-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:12:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-9790c32e-d1b2-4dd1-bd09-1beaf02ffb44 req-0c32be88-8926-4466-8ba2-f7838290c1aa service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received event network-vif-unplugged-0e3a5195-46e7-4e86-8eab-7d63d548463e for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Instance destroyed successfully.
Nov 30 11:12:57 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'resources' on Instance uuid ca9b8df9-6807-453b-9681-ef10a7686189 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1592259394',display_name='tempest-VolumesSnapshotTestJSON-instance-1592259394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1592259394',id=40,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKu2whvtl4onvUtQpLtc8XYi2k90KzKXzJMu7vpGGjtBuuzA2W8WAJqbB+PSq4ShzDL6TwhxeNWgYTGtRs708C+hZPQvhyTJ3UC1sP9Un56DA7QSGHAzrO65yLUm/oka1Q==',key_name='tempest-keypair-1042096782',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:10:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d6e6289c12e4cc4a4eceb1fb34af2f0',ramdisk_id='',reservation_id='r-cwgxw3zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2088929526',owner_user_name='tempest-VolumesSnapshotTestJSON-2088929526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26bab64764c4697bc01cf6ac0b6b8dc',uuid=ca9b8df9-6807-453b-9681-ef10a7686189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converting VIF {"id": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "address": "fa:16:3e:d7:18:79", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3a5195-46", "ovs_interfaceid": "0e3a5195-46e7-4e86-8eab-7d63d548463e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:18:79,bridge_name='br-int',has_traffic_filtering=True,id=0e3a5195-46e7-4e86-8eab-7d63d548463e,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3a5195-46') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_vif [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:18:79,bridge_name='br-int',has_traffic_filtering=True,id=0e3a5195-46e7-4e86-8eab-7d63d548463e,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3a5195-46') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e3a5195-46, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b9a6a56-119a-46d0-b1b4-873f856790cd) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:12:57 user nova-compute[75020]: INFO os_vif [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:18:79,bridge_name='br-int',has_traffic_filtering=True,id=0e3a5195-46e7-4e86-8eab-7d63d548463e,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3a5195-46')
Nov 30 11:12:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNdmfRUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:12:57 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[478114a7-c068-465d-a1a0-ad8843b67c26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:12:57 user nova-compute[75020]: No targets found.
Nov 30 11:12:57 user nova-compute[75020]: iSNS:
Nov 30 11:12:57 user nova-compute[75020]: No targets found.
Nov 30 11:12:57 user nova-compute[75020]: STATIC:
Nov 30 11:12:57 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:12:57 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:57 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:57 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:12:57 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:57 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:57 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60
Nov 30 11:12:57 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:57 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:57 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715
Nov 30 11:12:57 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:12:57 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:12:57 user nova-compute[75020]: FIRMWARE:
Nov 30 11:12:57 user nova-compute[75020]: No targets found.
Nov 30 11:12:57 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:12:57 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:12:57 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:125975f7-9dc1-4128-ace9-e596a9b20c74', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d9e68a-553c-436e-8969-9be25ebecb6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763f970-896a-4084-81ef-f4eeafbcc8c0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:57 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:57 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:57 user nova-compute[75020]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)
Nov 30 11:12:57 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:12:57 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:12:57 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:12:57 user nova-compute[75020]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)
Nov 30 11:12:57 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada85fd360>, {}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Disconnecting from: [] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] <== disconnect_volume: return (76ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:12:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Deleting instance files /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189_del
Nov 30 11:12:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Deletion of /opt/stack/data/nova/instances/ca9b8df9-6807-453b-9681-ef10a7686189_del complete
Nov 30 11:12:57 user nova-compute[75020]: INFO nova.compute.manager [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 30 11:12:57 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:12:57 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:12:58 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Took 0.97 seconds to deallocate network for instance.
Nov 30 11:12:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-30b0097a-565d-49f2-b0bf-4ed8080ec418 req-2a39b087-f5c1-46e6-b050-7b958f7d16b0 service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received event network-vif-deleted-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:58 user nova-compute[75020]: WARNING nova.volume.cinder [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Attachment 393d4c4e-735a-4713-ad15-defed0105112 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 393d4c4e-735a-4713-ad15-defed0105112. (HTTP 404) (Request-ID: req-c0292ff4-9135-4cac-b585-9daac20108ac)
Nov 30 11:12:58 user nova-compute[75020]: INFO nova.compute.manager [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Took 0.03 seconds to detach 1 volumes for instance.
Nov 30 11:12:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:58 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Deleted allocations for instance ca9b8df9-6807-453b-9681-ef10a7686189
Nov 30 11:12:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-c1486f92-9087-4912-90e5-46cfdf3862c6 req-c47975ee-b1b1-4403-9b77-1fee386667c9 service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received event network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c1486f92-9087-4912-90e5-46cfdf3862c6 req-c47975ee-b1b1-4403-9b77-1fee386667c9 service nova] Acquiring lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c1486f92-9087-4912-90e5-46cfdf3862c6 req-c47975ee-b1b1-4403-9b77-1fee386667c9 service nova] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c1486f92-9087-4912-90e5-46cfdf3862c6 req-c47975ee-b1b1-4403-9b77-1fee386667c9 service nova] Lock "ca9b8df9-6807-453b-9681-ef10a7686189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-c1486f92-9087-4912-90e5-46cfdf3862c6 req-c47975ee-b1b1-4403-9b77-1fee386667c9 service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] No waiting events found dispatching network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:12:58 user nova-compute[75020]: WARNING nova.compute.manager [req-c1486f92-9087-4912-90e5-46cfdf3862c6 req-c47975ee-b1b1-4403-9b77-1fee386667c9 service nova] [instance: ca9b8df9-6807-453b-9681-ef10a7686189] Received unexpected event network-vif-plugged-0e3a5195-46e7-4e86-8eab-7d63d548463e for instance with vm_state deleted and task_state None.
Nov 30 11:12:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0d4ee791-f9e6-4737-ab03-8eb93f9b78a9 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "ca9b8df9-6807-453b-9681-ef10a7686189" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.379s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:12:59 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:12:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:12:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:12:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:12:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:12:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:12:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:12:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:13:00 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd is timed out.
Nov 30 11:13:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Successfully detached device vdb from instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd from the live domain config.
Nov 30 11:13:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWARtsuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:13:00 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[554ef8b8-9080-4aa3-81c5-05c95a3a600e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:13:00 user nova-compute[75020]: No targets found.
Nov 30 11:13:00 user nova-compute[75020]: iSNS:
Nov 30 11:13:00 user nova-compute[75020]: No targets found.
Nov 30 11:13:00 user nova-compute[75020]: STATIC:
Nov 30 11:13:00 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:13:00 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:00 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:00 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:13:00 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:00 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:00 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60
Nov 30 11:13:00 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:00 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:00 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715
Nov 30 11:13:00 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:00 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:00 user nova-compute[75020]: FIRMWARE:
Nov 30 11:13:00 user nova-compute[75020]: No targets found.
Nov 30 11:13:00 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:13:00 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:13:00 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ae58a5-25cf-48df-807b-970b39a9ef06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ecf547-0eaf-4355-bd1b-cdd88aac3022]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:00 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:13:00 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:13:00 user nova-compute[75020]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)
Nov 30 11:13:00 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:00 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:13:00 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:13:00 user nova-compute[75020]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 (non-flash)
Nov 30 11:13:00 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada848d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715'): ({'sdf'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Removing single pathed devices sdf {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c31d3e7-eb32-4b2c-9017-a84e9bf74294]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e11c9f-e41b-4b97-82af-6df7b257a478]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Flushing IO for device /dev/sdf {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3aafe7-24b3-4d23-b790-c8365437f2b8]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:13:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e3f0c-8dd3-40fd-8898-d1c58589d9dc]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] SCSI volumes sdf have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74597d4-c63b-4d34-8812-67583529b633]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7218765a-6bb3-4aec-bd79-0533d37d5f95]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715, portal: 172.16.0.220,3260]
Nov 30 11:13:01 user nova-compute[75020]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715, portal: 172.16.0.220,3260] successful.
Nov 30 11:13:01 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7856a60-963d-4f14-bc3c-0942a222b715 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea2493-d9b3-482b-b484-8e39f165c884]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] <== disconnect_volume: return (351ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:13:01 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lazy-loading 'flavor' on Instance uuid 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:02 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:13:02 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=25.187923431396484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f7bf7ccc-0b5e-4286-8b42-67f7db847651 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.107s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Applying migration context for instance edfaac3a-50a5-4b24-881e-cb5a6baedbae as it has an incoming, in-progress migration c080f242-c927-4ffe-84ed-e4dfe3bcbe47. Migration status is finished {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 11:13:02 user nova-compute[75020]: INFO nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating resource usage from migration c080f242-c927-4ffe-84ed-e4dfe3bcbe47
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance aaee883f-b87b-43c2-af7c-dfb8a7a42c05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 3c4e7f7f-37ae-40c1-a77c-113c340933b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Migration c080f242-c927-4ffe-84ed-e4dfe3bcbe47 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=22GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:13:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:06 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:13:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9ed72f5-b2a8-4fca-8f99-2370e21baf30 req-cba64fd3-a1ea-4153-b4bf-83c1c9ef2394 service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-changed-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:14 user nova-compute[75020]: DEBUG nova.compute.manager [req-e9ed72f5-b2a8-4fca-8f99-2370e21baf30 req-cba64fd3-a1ea-4153-b4bf-83c1c9ef2394 service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Refreshing instance network info cache due to event network-changed-f42e43ef-2367-4d69-af6d-21dde057f4bf. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:13:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9ed72f5-b2a8-4fca-8f99-2370e21baf30 req-cba64fd3-a1ea-4153-b4bf-83c1c9ef2394 service nova] Acquiring lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9ed72f5-b2a8-4fca-8f99-2370e21baf30 req-cba64fd3-a1ea-4153-b4bf-83c1c9ef2394 service nova] Acquired lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-e9ed72f5-b2a8-4fca-8f99-2370e21baf30 req-cba64fd3-a1ea-4153-b4bf-83c1c9ef2394 service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Refreshing network info cache for port f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:13:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-e9ed72f5-b2a8-4fca-8f99-2370e21baf30 req-cba64fd3-a1ea-4153-b4bf-83c1c9ef2394 service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updated VIF entry in instance network info cache for port f42e43ef-2367-4d69-af6d-21dde057f4bf. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:13:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-e9ed72f5-b2a8-4fca-8f99-2370e21baf30 req-cba64fd3-a1ea-4153-b4bf-83c1c9ef2394 service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updating instance_info_cache with network_info: [{"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e9ed72f5-b2a8-4fca-8f99-2370e21baf30 req-cba64fd3-a1ea-4153-b4bf-83c1c9ef2394 service nova] Releasing lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG nova.compute.manager [req-921c92ab-adc0-4c8a-905b-a4c328ce9c51 req-f7ef76f5-75d8-4390-a2a8-bc21b951363f service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-changed-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG nova.compute.manager [req-921c92ab-adc0-4c8a-905b-a4c328ce9c51 req-f7ef76f5-75d8-4390-a2a8-bc21b951363f service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Refreshing instance network info cache due to event network-changed-f42e43ef-2367-4d69-af6d-21dde057f4bf. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-921c92ab-adc0-4c8a-905b-a4c328ce9c51 req-f7ef76f5-75d8-4390-a2a8-bc21b951363f service nova] Acquiring lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-921c92ab-adc0-4c8a-905b-a4c328ce9c51 req-f7ef76f5-75d8-4390-a2a8-bc21b951363f service nova] Acquired lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG nova.network.neutron [req-921c92ab-adc0-4c8a-905b-a4c328ce9c51 req-f7ef76f5-75d8-4390-a2a8-bc21b951363f service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Refreshing network info cache for port f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:15 user nova-compute[75020]: INFO nova.compute.manager [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Terminating instance
Nov 30 11:13:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG nova.network.neutron [req-921c92ab-adc0-4c8a-905b-a4c328ce9c51 req-f7ef76f5-75d8-4390-a2a8-bc21b951363f service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updated VIF entry in instance network info cache for port f42e43ef-2367-4d69-af6d-21dde057f4bf. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG nova.network.neutron [req-921c92ab-adc0-4c8a-905b-a4c328ce9c51 req-f7ef76f5-75d8-4390-a2a8-bc21b951363f service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updating instance_info_cache with network_info: [{"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-921c92ab-adc0-4c8a-905b-a4c328ce9c51 req-f7ef76f5-75d8-4390-a2a8-bc21b951363f service nova] Releasing lock "refresh_cache-3c4e7f7f-37ae-40c1-a77c-113c340933b9" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Instance destroyed successfully.
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.objects.instance [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'resources' on Instance uuid 3c4e7f7f-37ae-40c1-a77c-113c340933b9 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-490213544',display_name='tempest-TestVolumeBootPattern-server-490213544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-490213544',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-8d05h3cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:11:37Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=3c4e7f7f-37ae-40c1-a77c-113c340933b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "address": "fa:16:3e:a1:5e:6d", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42e43ef-23", "ovs_interfaceid": "f42e43ef-2367-4d69-af6d-21dde057f4bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:5e:6d,bridge_name='br-int',has_traffic_filtering=True,id=f42e43ef-2367-4d69-af6d-21dde057f4bf,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42e43ef-23') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_vif [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:5e:6d,bridge_name='br-int',has_traffic_filtering=True,id=f42e43ef-2367-4d69-af6d-21dde057f4bf,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42e43ef-23') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf42e43ef-23, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e7a5f6f-7a5e-41fc-a47d-a7516bed857b) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: INFO os_vif [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:5e:6d,bridge_name='br-int',has_traffic_filtering=True,id=f42e43ef-2367-4d69-af6d-21dde057f4bf,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42e43ef-23')
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFWBxovt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:13:16 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f15f8b1-15f6-46d3-ab5a-6aaf2b4d01a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:13:16 user nova-compute[75020]: No targets found.
Nov 30 11:13:16 user nova-compute[75020]: iSNS:
Nov 30 11:13:16 user nova-compute[75020]: No targets found.
Nov 30 11:13:16 user nova-compute[75020]: STATIC:
Nov 30 11:13:16 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:13:16 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:16 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:16 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:13:16 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:16 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:16 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60
Nov 30 11:13:16 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:16 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:16 user nova-compute[75020]: FIRMWARE:
Nov 30 11:13:16 user nova-compute[75020]: No targets found.
Nov 30 11:13:16 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:13:16 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:13:16 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f6f47-529b-40e3-8d21-a82de89ee869]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cab8c5-9a35-4d01-b5b9-83315f1c7854]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:16 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:13:16 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:13:16 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:16 user nova-compute[75020]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 (non-flash)
Nov 30 11:13:16 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:13:16 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88684f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5d20b1-c1ef-4ba3-906f-94ca047bba34]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e714f-60e2-4505-81f9-70ba6a99107c]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e8ef9-10e1-498e-86e5-80c64e7037c3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7159f46-43f7-462f-8280-8a518803ef72]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO81f34b74-560531147fb48f31', '/dev/disk/by-id/scsi-23536303533313134', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_81f34b74') {{(pid=86371) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bc4ddd-7f8a-4643-a73e-12bd167bef5c]: (4, None) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6abbff4-8882-461a-a2db-bbcc37e38e54]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0119f3c-cde0-47c5-9d5d-ded4e0956a3b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60, portal: 172.16.0.220,3260]
Nov 30 11:13:16 user nova-compute[75020]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60, portal: 172.16.0.220,3260] successful.
Nov 30 11:13:16 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-unplugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] No waiting events found dispatching network-vif-unplugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-unplugged-f42e43ef-2367-4d69-af6d-21dde057f4bf for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] No waiting events found dispatching network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:16 user nova-compute[75020]: WARNING nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received unexpected event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf for instance with vm_state active and task_state deleting.
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] No waiting events found dispatching network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:16 user nova-compute[75020]: WARNING nova.compute.manager [req-c44dcc36-75a6-4f59-8d79-d495ab652b9c req-ef916232-1443-45f2-a7ff-99b755b831dd service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received unexpected event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf for instance with vm_state active and task_state deleting.
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dab0510-b2f3-4025-97e2-075707ec3e60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[09144447-6f4d-4ccd-b9c2-e8f41deea9da]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== disconnect_volume: return (351ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:13:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Deleting instance files /opt/stack/data/nova/instances/3c4e7f7f-37ae-40c1-a77c-113c340933b9_del
Nov 30 11:13:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Deletion of /opt/stack/data/nova/instances/3c4e7f7f-37ae-40c1-a77c-113c340933b9_del complete
Nov 30 11:13:16 user nova-compute[75020]: INFO nova.compute.manager [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 30 11:13:16 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:17 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:17 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Took 0.65 seconds to deallocate network for instance.
Nov 30 11:13:18 user nova-compute[75020]: INFO nova.compute.manager [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Took 0.79 seconds to detach 1 volumes for instance.
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:18 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Deleted allocations for instance 3c4e7f7f-37ae-40c1-a77c-113c340933b9
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35a369a2-0354-4ce1-92ed-ad872e860735 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.098s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] No waiting events found dispatching network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:18 user nova-compute[75020]: WARNING nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received unexpected event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf for instance with vm_state deleted and task_state None.
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-unplugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] No waiting events found dispatching network-vif-unplugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:18 user nova-compute[75020]: WARNING nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received unexpected event network-vif-unplugged-f42e43ef-2367-4d69-af6d-21dde057f4bf for instance with vm_state deleted and task_state None.
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Acquiring lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] Lock "3c4e7f7f-37ae-40c1-a77c-113c340933b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] No waiting events found dispatching network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:18 user nova-compute[75020]: WARNING nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received unexpected event network-vif-plugged-f42e43ef-2367-4d69-af6d-21dde057f4bf for instance with vm_state deleted and task_state None.
Nov 30 11:13:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-58e43a7b-9939-4534-8227-3a624cb3a0bc req-0c65b834-e3e2-47cc-a8ed-3629142caa5c service nova] [instance: 3c4e7f7f-37ae-40c1-a77c-113c340933b9] Received event network-vif-deleted-f42e43ef-2367-4d69-af6d-21dde057f4bf {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:35 user nova-compute[75020]: INFO nova.compute.manager [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Terminating instance
Nov 30 11:13:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Instance destroyed successfully.
Nov 30 11:13:35 user nova-compute[75020]: DEBUG nova.objects.instance [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lazy-loading 'resources' on Instance uuid 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-544609355',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-544609355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5446093',id=41,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLKFZNWWpUtiTd+t8tqdlHb9CV7L9bVvV5bW4VFZzUOR4eJow2nofGGZEnfXZOHY2N1ZFtRzmYV0OrqiyBWTBk7IcCibgm37q8NvntdX7fldTBZdrbP7JaIzqBnggbcxA==',key_name='tempest-keypair-698969879',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a5d7100ace4533afcf8877c324688f',ramdisk_id='',reservation_id='r-63ib9vdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-728025175',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c45cc9328084164b4b43638befb99b9',uuid=6fc77719-49fc-45e3-9d3e-7b3f92fd2afd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Converting VIF {"id": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "address": "fa:16:3e:b2:cc:fb", "network": {"id": "b9988213-f707-4b4b-bd67-65c412f286fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2141721861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a5d7100ace4533afcf8877c324688f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b79ea84-f3", "ovs_interfaceid": "6b79ea84-f3be-4da0-bf26-8a626036a38f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=6b79ea84-f3be-4da0-bf26-8a626036a38f,network=Network(b9988213-f707-4b4b-bd67-65c412f286fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b79ea84-f3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG os_vif [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=6b79ea84-f3be-4da0-bf26-8a626036a38f,network=Network(b9988213-f707-4b4b-bd67-65c412f286fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b79ea84-f3') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b79ea84-f3, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dec77e3-f982-410f-87c4-c48bec3d1232) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:35 user nova-compute[75020]: INFO os_vif [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=6b79ea84-f3be-4da0-bf26-8a626036a38f,network=Network(b9988213-f707-4b4b-bd67-65c412f286fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b79ea84-f3')
Nov 30 11:13:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Deleting instance files /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd_del
Nov 30 11:13:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Deletion of /opt/stack/data/nova/instances/6fc77719-49fc-45e3-9d3e-7b3f92fd2afd_del complete
Nov 30 11:13:35 user nova-compute[75020]: INFO nova.compute.manager [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 30 11:13:35 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:13:35 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:13:36 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:36 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Took 0.73 seconds to deallocate network for instance.
Nov 30 11:13:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-3acf51ee-5387-4a2a-b42e-d8818e5b67ac req-02fd87a3-607d-4264-966d-d6c206144093 service nova] [instance: 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd] Received event network-vif-deleted-6b79ea84-f3be-4da0-bf26-8a626036a38f {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:36 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:13:36 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:13:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:37 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Deleted allocations for instance 6fc77719-49fc-45e3-9d3e-7b3f92fd2afd
Nov 30 11:13:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-91de4b99-b0b9-48c4-8ac0-765e21e55f86 tempest-TestServerVolumeAttachScenarioOldVersion-728025175 tempest-TestServerVolumeAttachScenarioOldVersion-728025175-project-member] Lock "6fc77719-49fc-45e3-9d3e-7b3f92fd2afd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:13:42 user nova-compute[75020]: INFO nova.compute.claims [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Claim successful on node user
Nov 30 11:13:42 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:13:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:13:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:13:43 user nova-compute[75020]: INFO nova.virt.block_device [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Booting with volume b054d69b-0d3c-4c2a-9f2c-6080a83967fd at /dev/vda
Nov 30 11:13:43 user nova-compute[75020]: DEBUG os_brick.utils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddc893d-e2f9-425e-b674-2c47349e3e97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70989a1-b7a5-40da-892e-c365ce688706]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00f5384-2845-4871-9f99-9af6ed3bdad6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[04315a73-9f11-4ad2-9f6d-d493a942b570]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG nova.policy [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74a15904d850429fab41c80e4c6631d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02534bcb5c8949b0b023951460be4f95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:13:43 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:13:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda46368-26f8-4570-8b6f-4377ffe3eaf0]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG os_brick.utils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:13:43 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating existing volume attachment record: 0fddde0a-41da-4689-abda-d73e2761ca1b {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Successfully created port: a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Successfully updated port: a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-e58acafe-997c-4dd9-8467-e9963177c738 req-9fdf6354-1de1-4ac4-a68e-6aa90eda07fe service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-e58acafe-997c-4dd9-8467-e9963177c738 req-9fdf6354-1de1-4ac4-a68e-6aa90eda07fe service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing instance network info cache due to event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e58acafe-997c-4dd9-8467-e9963177c738 req-9fdf6354-1de1-4ac4-a68e-6aa90eda07fe service nova] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:44 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG nova.network.neutron [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance network_info: |[{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e58acafe-997c-4dd9-8467-e9963177c738 req-9fdf6354-1de1-4ac4-a68e-6aa90eda07fe service nova] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-e58acafe-997c-4dd9-8467-e9963177c738 req-9fdf6354-1de1-4ac4-a68e-6aa90eda07fe service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-e58acafe-997c-4dd9-8467-e9963177c738 req-9fdf6354-1de1-4ac4-a68e-6aa90eda07fe service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updated VIF entry in instance network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-e58acafe-997c-4dd9-8467-e9963177c738 req-9fdf6354-1de1-4ac4-a68e-6aa90eda07fe service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e58acafe-997c-4dd9-8467-e9963177c738 req-9fdf6354-1de1-4ac4-a68e-6aa90eda07fe service nova] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:45 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:13:45 user nova-compute[75020]: INFO nova.compute.claims [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Claim successful on node user
Nov 30 11:13:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:13:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.policy [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e26bab64764c4697bc01cf6ac0b6b8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e6289c12e4cc4a4eceb1fb34af2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:13:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Creating image(s)
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "/opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "/opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk 1073741824" returned: 0 in 0.051s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Successfully created port: 78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.197s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:13:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Cannot resize image /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Ensure instance console log exists: /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Successfully updated port: 78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquired lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-a4bbe9be-3e0c-476c-8999-da2b4525d59a req-3bbe2a34-846f-450a-a314-aa46c4f9b617 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received event network-changed-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-a4bbe9be-3e0c-476c-8999-da2b4525d59a req-3bbe2a34-846f-450a-a314-aa46c4f9b617 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Refreshing instance network info cache due to event network-changed-78f47b07-a204-475d-8dc9-47dd762f1ce0. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a4bbe9be-3e0c-476c-8999-da2b4525d59a req-3bbe2a34-846f-450a-a314-aa46c4f9b617 service nova] Acquiring lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Updating instance_info_cache with network_info: [{"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Releasing lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Instance network_info: |[{"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a4bbe9be-3e0c-476c-8999-da2b4525d59a req-3bbe2a34-846f-450a-a314-aa46c4f9b617 service nova] Acquired lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-a4bbe9be-3e0c-476c-8999-da2b4525d59a req-3bbe2a34-846f-450a-a314-aa46c4f9b617 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Refreshing network info cache for port 78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Start _get_guest_xml network_info=[{"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:13:47 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:13:47 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-118273757',display_name='tempest-VolumesSnapshotTestJSON-instance-118273757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-118273757',id=44,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX+0R5Jtog8OXeLY4gjWfv1TEatY//oQD02CQuTdNbmwxeSBfkV2051d9JCsSrJycwG/uTawNjn8sheeJVJrLvhevtOMdQTfuBMyYOG7vE0BalosngF0Im9mmZouTcW1A==',key_name='tempest-keypair-1505637640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d6e6289c12e4cc4a4eceb1fb34af2f0',ramdisk_id='',reservation_id='r-unem32q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2088929526',owner_user_name='tempest-VolumesSnapshotTestJSON-2088929526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26bab64764c4697bc01cf6ac0b6b8dc',uuid=dc17dce7-e1b2-4f40-b5a6-036a56e5aaad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converting VIF {"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:e5,bridge_name='br-int',has_traffic_filtering=True,id=78f47b07-a204-475d-8dc9-47dd762f1ce0,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f47b07-a2') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'pci_devices' on Instance uuid dc17dce7-e1b2-4f40-b5a6-036a56e5aaad {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:13:47 user nova-compute[75020]:   <uuid>dc17dce7-e1b2-4f40-b5a6-036a56e5aaad</uuid>
Nov 30 11:13:47 user nova-compute[75020]:   <name>instance-0000002c</name>
Nov 30 11:13:47 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:13:47 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:13:47 user nova-compute[75020]:   <metadata>
Nov 30 11:13:47 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:13:47 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:13:47 user nova-compute[75020]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-118273757</nova:name>
Nov 30 11:13:47 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:13:47</nova:creationTime>
Nov 30 11:13:47 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:13:47 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:13:47 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:13:47 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:13:47 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:13:47 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:13:47 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:13:47 user nova-compute[75020]:       <nova:owner>
Nov 30 11:13:47 user nova-compute[75020]:         <nova:user uuid="e26bab64764c4697bc01cf6ac0b6b8dc">tempest-VolumesSnapshotTestJSON-2088929526-project-member</nova:user>
Nov 30 11:13:47 user nova-compute[75020]:         <nova:project uuid="8d6e6289c12e4cc4a4eceb1fb34af2f0">tempest-VolumesSnapshotTestJSON-2088929526</nova:project>
Nov 30 11:13:47 user nova-compute[75020]:       </nova:owner>
Nov 30 11:13:47 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:13:47 user nova-compute[75020]:       <nova:ports>
Nov 30 11:13:47 user nova-compute[75020]:         <nova:port uuid="78f47b07-a204-475d-8dc9-47dd762f1ce0">
Nov 30 11:13:47 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 11:13:47 user nova-compute[75020]:         </nova:port>
Nov 30 11:13:47 user nova-compute[75020]:       </nova:ports>
Nov 30 11:13:47 user nova-compute[75020]:     </nova:instance>
Nov 30 11:13:47 user nova-compute[75020]:   </metadata>
Nov 30 11:13:47 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:13:47 user nova-compute[75020]:     <system>
Nov 30 11:13:47 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:13:47 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:13:47 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:13:47 user nova-compute[75020]:       <entry name="serial">dc17dce7-e1b2-4f40-b5a6-036a56e5aaad</entry>
Nov 30 11:13:47 user nova-compute[75020]:       <entry name="uuid">dc17dce7-e1b2-4f40-b5a6-036a56e5aaad</entry>
Nov 30 11:13:47 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:13:47 user nova-compute[75020]:     </system>
Nov 30 11:13:47 user nova-compute[75020]:   </sysinfo>
Nov 30 11:13:47 user nova-compute[75020]:   <os>
Nov 30 11:13:47 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:13:47 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:13:47 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:13:47 user nova-compute[75020]:   </os>
Nov 30 11:13:47 user nova-compute[75020]:   <features>
Nov 30 11:13:47 user nova-compute[75020]:     <acpi/>
Nov 30 11:13:47 user nova-compute[75020]:     <apic/>
Nov 30 11:13:47 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:13:47 user nova-compute[75020]:   </features>
Nov 30 11:13:47 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:13:47 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:13:47 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:13:47 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:13:47 user nova-compute[75020]:   </clock>
Nov 30 11:13:47 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:13:47 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:13:47 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:13:47 user nova-compute[75020]:   </cpu>
Nov 30 11:13:47 user nova-compute[75020]:   <devices>
Nov 30 11:13:47 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:13:47 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:13:47 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk"/>
Nov 30 11:13:47 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:13:47 user nova-compute[75020]:     </disk>
Nov 30 11:13:47 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:13:47 user nova-compute[75020]:       <mac address="fa:16:3e:86:ab:e5"/>
Nov 30 11:13:47 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:13:47 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:13:47 user nova-compute[75020]:       <target dev="tap78f47b07-a2"/>
Nov 30 11:13:47 user nova-compute[75020]:     </interface>
Nov 30 11:13:47 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:13:47 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/console.log" append="off"/>
Nov 30 11:13:47 user nova-compute[75020]:     </serial>
Nov 30 11:13:47 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:13:47 user nova-compute[75020]:     <video>
Nov 30 11:13:47 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:13:47 user nova-compute[75020]:     </video>
Nov 30 11:13:47 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:13:47 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:13:47 user nova-compute[75020]:     </rng>
Nov 30 11:13:47 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:13:47 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:13:47 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:13:47 user nova-compute[75020]:     </memballoon>
Nov 30 11:13:47 user nova-compute[75020]:   </devices>
Nov 30 11:13:47 user nova-compute[75020]: </domain>
Nov 30 11:13:47 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-118273757',display_name='tempest-VolumesSnapshotTestJSON-instance-118273757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-118273757',id=44,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX+0R5Jtog8OXeLY4gjWfv1TEatY//oQD02CQuTdNbmwxeSBfkV2051d9JCsSrJycwG/uTawNjn8sheeJVJrLvhevtOMdQTfuBMyYOG7vE0BalosngF0Im9mmZouTcW1A==',key_name='tempest-keypair-1505637640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d6e6289c12e4cc4a4eceb1fb34af2f0',ramdisk_id='',reservation_id='r-unem32q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2088929526',owner_user_name='tempest-VolumesSnapshotTestJSON-2088929526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26bab64764c4697bc01cf6ac0b6b8dc',uuid=dc17dce7-e1b2-4f40-b5a6-036a56e5aaad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converting VIF {"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:e5,bridge_name='br-int',has_traffic_filtering=True,id=78f47b07-a204-475d-8dc9-47dd762f1ce0,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f47b07-a2') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG os_vif [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:e5,bridge_name='br-int',has_traffic_filtering=True,id=78f47b07-a204-475d-8dc9-47dd762f1ce0,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f47b07-a2') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8220ed92-8a32-550c-b977-e57b51cf317e', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78f47b07-a2, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78f47b07-a2, col_values=(('qos', UUID('d400e312-33e9-49a4-bd08-4dcaf1a97ce5')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78f47b07-a2, col_values=(('external_ids', {'iface-id': '78f47b07-a204-475d-8dc9-47dd762f1ce0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:ab:e5', 'vm-uuid': 'dc17dce7-e1b2-4f40-b5a6-036a56e5aaad'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:47 user nova-compute[75020]: INFO os_vif [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:e5,bridge_name='br-int',has_traffic_filtering=True,id=78f47b07-a204-475d-8dc9-47dd762f1ce0,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f47b07-a2')
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:13:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No VIF found with MAC fa:16:3e:86:ab:e5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:13:48 user nova-compute[75020]: DEBUG nova.network.neutron [req-a4bbe9be-3e0c-476c-8999-da2b4525d59a req-3bbe2a34-846f-450a-a314-aa46c4f9b617 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Updated VIF entry in instance network info cache for port 78f47b07-a204-475d-8dc9-47dd762f1ce0. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:13:48 user nova-compute[75020]: DEBUG nova.network.neutron [req-a4bbe9be-3e0c-476c-8999-da2b4525d59a req-3bbe2a34-846f-450a-a314-aa46c4f9b617 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Updating instance_info_cache with network_info: [{"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a4bbe9be-3e0c-476c-8999-da2b4525d59a req-3bbe2a34-846f-450a-a314-aa46c4f9b617 service nova] Releasing lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-846c1cde-70c0-45d1-ae0b-868df543c6f1 req-51566b12-22e9-4be4-828e-7983b1e71fca service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received event network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-846c1cde-70c0-45d1-ae0b-868df543c6f1 req-51566b12-22e9-4be4-828e-7983b1e71fca service nova] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-846c1cde-70c0-45d1-ae0b-868df543c6f1 req-51566b12-22e9-4be4-828e-7983b1e71fca service nova] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-846c1cde-70c0-45d1-ae0b-868df543c6f1 req-51566b12-22e9-4be4-828e-7983b1e71fca service nova] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-846c1cde-70c0-45d1-ae0b-868df543c6f1 req-51566b12-22e9-4be4-828e-7983b1e71fca service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] No waiting events found dispatching network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:49 user nova-compute[75020]: WARNING nova.compute.manager [req-846c1cde-70c0-45d1-ae0b-868df543c6f1 req-51566b12-22e9-4be4-828e-7983b1e71fca service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received unexpected event network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 for instance with vm_state building and task_state spawning.
Nov 30 11:13:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Port 503a9796-e188-4a72-a429-df54ae6acc01 binding to destination host user is already ACTIVE {{(pid=75020) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Creating tmpfile /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/tmps2o6juay to verify with other compute node that the instance is on the same shared storage. {{(pid=75020) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-89ff0e41-5de0-4e10-af09-d0ea3ab60d25 req-f44fab89-1693-4e8b-bd38-9d6469b44476 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-89ff0e41-5de0-4e10-af09-d0ea3ab60d25 req-f44fab89-1693-4e8b-bd38-9d6469b44476 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-89ff0e41-5de0-4e10-af09-d0ea3ab60d25 req-f44fab89-1693-4e8b-bd38-9d6469b44476 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-89ff0e41-5de0-4e10-af09-d0ea3ab60d25 req-f44fab89-1693-4e8b-bd38-9d6469b44476 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-89ff0e41-5de0-4e10-af09-d0ea3ab60d25 req-f44fab89-1693-4e8b-bd38-9d6469b44476 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:50 user nova-compute[75020]: WARNING nova.compute.manager [req-89ff0e41-5de0-4e10-af09-d0ea3ab60d25 req-f44fab89-1693-4e8b-bd38-9d6469b44476 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state resized and task_state resize_reverting.
Nov 30 11:13:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:50 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance destroyed successfully.
Nov 30 11:13:50 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lazy-loading 'resources' on Instance uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_vif [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap503a9796-e1, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0d78080-6164-41fa-9ea7-f124f27725be) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:51 user nova-compute[75020]: INFO os_vif [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1')
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:13:51 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[513e9489-d5cf-43e0-addc-f12456db1f9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:13:51 user nova-compute[75020]: No targets found.
Nov 30 11:13:51 user nova-compute[75020]: iSNS:
Nov 30 11:13:51 user nova-compute[75020]: No targets found.
Nov 30 11:13:51 user nova-compute[75020]: STATIC:
Nov 30 11:13:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:13:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:13:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:13:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:13:51 user nova-compute[75020]: FIRMWARE:
Nov 30 11:13:51 user nova-compute[75020]: No targets found.
Nov 30 11:13:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:13:51 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:13:51 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d985b82c-12bd-4433-a8c1-1f940a564fde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe89001-cda5-4840-9e6d-9327827b8d61]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:51 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:13:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:51 user nova-compute[75020]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:13:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88600af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a'): ({'sde'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Removing single pathed devices sde {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e244e6-290f-4d02-aa84-a89c016a0b8a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc1ebe9-c597-4485-9372-a33243d8bef5]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flushing IO for device /dev/sde {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[432b7822-fdfa-4085-8b33-3eaf87f048c1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bbe4b5-d1a2-4e14-8268-23e7ec2bcda0]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] SCSI volumes sde have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ace7b-dc89-4f4d-94b8-3859058ad004]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[26798c9a-594c-4965-8515-911be5a673cb]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]
Nov 30 11:13:51 user nova-compute[75020]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.
Nov 30 11:13:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b949d5e-d0b2-4c44-86fb-86193eb7f3f3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== disconnect_volume: return (345ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:13:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Instance spawned successfully.
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-fd2d1d58-07cc-4d5d-be26-e8c29de0b195 req-65238804-670f-459e-bfa4-055463ea0a84 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received event network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fd2d1d58-07cc-4d5d-be26-e8c29de0b195 req-65238804-670f-459e-bfa4-055463ea0a84 service nova] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fd2d1d58-07cc-4d5d-be26-e8c29de0b195 req-65238804-670f-459e-bfa4-055463ea0a84 service nova] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fd2d1d58-07cc-4d5d-be26-e8c29de0b195 req-65238804-670f-459e-bfa4-055463ea0a84 service nova] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-fd2d1d58-07cc-4d5d-be26-e8c29de0b195 req-65238804-670f-459e-bfa4-055463ea0a84 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] No waiting events found dispatching network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:51 user nova-compute[75020]: WARNING nova.compute.manager [req-fd2d1d58-07cc-4d5d-be26-e8c29de0b195 req-65238804-670f-459e-bfa4-055463ea0a84 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received unexpected event network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 for instance with vm_state building and task_state spawning.
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: INFO nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 30 11:13:51 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:51 user nova-compute[75020]: INFO nova.compute.manager [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Took 6.08 seconds to build instance.
Nov 30 11:13:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2738e125-0f84-457a-b32b-00ab4b2eeafa tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.179s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lazy-loading 'migration_context' on Instance uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.objects.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Object Instance<edfaac3a-50a5-4b24-881e-cb5a6baedbae> lazy-loaded attributes: resources,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:52 user nova-compute[75020]: WARNING nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state resized and task_state resize_reverting.
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:52 user nova-compute[75020]: WARNING nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state resized and task_state resize_reverting.
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:52 user nova-compute[75020]: WARNING nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state resized and task_state resize_reverting.
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:52 user nova-compute[75020]: WARNING nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state resized and task_state resize_reverting.
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:52 user nova-compute[75020]: WARNING nova.compute.manager [req-64d92803-ae2f-4d9e-83c8-16b700cdc4fc req-2edfb914-0bbf-43d3-acde-adb3b2217f46 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state resized and task_state resize_reverting.
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.318s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:52 user nova-compute[75020]: INFO nova.compute.manager [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Swapping old allocation on dict_keys(['88367873-990b-4954-a4a6-b7b412a97446']) held by migration c080f242-c927-4ffe-84ed-e4dfe3bcbe47 for instance
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:13:52 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Creating image(s)
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Ensure instance console log exists: /opt/stack/data/nova/instances/7c92477d-7202-45de-9da8-667b5f2dc168/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Start _get_guest_xml network_info=[{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '0fddde0a-41da-4689-abda-d73e2761ca1b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpVIUtcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c92477d-7202-45de-9da8-667b5f2dc168', 'attached_at': '', 'detached_at': '', 'volume_id': 'b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'serial': 'b054d69b-0d3c-4c2a-9f2c-6080a83967fd'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:13:52 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:13:52 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpVIUtcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:13:53 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:13:53 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:13:53 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Overwriting current allocation {'allocations': {'88367873-990b-4954-a4a6-b7b412a97446': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 53}}, 'project_id': 'f399c3a5bd2d4acf815b09df902f226c', 'user_id': '5a5d2305e8d346009c88bb5324446309', 'consumer_generation': 1} on consumer edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e5e768-0e33-4c14-8714-8f21d13e971c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:13:53 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d174ce-e642-45b6-885e-28244cb7b061]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd] added
Nov 30 11:13:53 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca808c2-507d-4e39-8a43-e3f2cd756acc]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8c9c83-668b-46a3-8391-079aea798443]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DpVIUtcb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DpVIUtcb" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff128cf5-83e2-43a3-9c1a-65f159055e5e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DpVIUtcb'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c492240-51eb-4693-8ee9-bceda3363dae]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e4e9aa-5c55-480b-a43d-066499c8f5ea]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:53 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:53 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64f938a-f09b-45bc-833b-3a331ca17289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260]
Nov 30 11:13:53 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260] successful.
Nov 30 11:13:53 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb683417-33f8-483d-8a6b-14f698647525]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d153e-9fca-483c-86ca-a5bd9eabdac3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:53 user nova-compute[75020]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:13:53 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:13:53 user nova-compute[75020]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:13:53 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45cdb35-f058-4d47-ac8b-98e9322eebfc]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:13:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpVIUtcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_brick.utils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff243da-1a2b-4102-92b4-eb0a40986870]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[be326f69-e84f-4ca2-9f41-c5aa2900cfbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3577e4c8-6cfd-4f06-ae31-392f665d4aef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ad2494-b9b0-45bd-864d-a336b3e0a898]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:13:54 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:13:54 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fbac86-bc2b-44fa-a14e-52cd5fed8691]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_brick.utils [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23130636230646261', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130636230646261', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2019628760',display_name='tempest-TestShelveInstance-server-2019628760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2019628760',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzq3/tQkHAmTBqJ5eeS8uUPmm0fwiu9Z1MnLpnljhN1EZuTf0LCLNkVtxDajRUKBJXR1go+BfOBSi64HbRK7hdPAC5opfsidqCXoKISex/eWHUgcQYr4iZ6uAfcVeBEVA==',key_name='tempest-TestShelveInstance-1341904812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02534bcb5c8949b0b023951460be4f95',ramdisk_id='',reservation_id='r-79ialavl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-887229388',owner_user_name='tempest-TestShelveInstance-887229388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:13:43Z,user_data=None,user_id='74a15904d850429fab41c80e4c6631d3',uuid=7c92477d-7202-45de-9da8-667b5f2dc168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converting VIF {"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.objects.instance [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:13:54 user nova-compute[75020]:   <uuid>7c92477d-7202-45de-9da8-667b5f2dc168</uuid>
Nov 30 11:13:54 user nova-compute[75020]:   <name>instance-0000002b</name>
Nov 30 11:13:54 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:13:54 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:13:54 user nova-compute[75020]:   <metadata>
Nov 30 11:13:54 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:13:54 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:13:54 user nova-compute[75020]:       <nova:name>tempest-TestShelveInstance-server-2019628760</nova:name>
Nov 30 11:13:54 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:13:52</nova:creationTime>
Nov 30 11:13:54 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:13:54 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:13:54 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:13:54 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:13:54 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:13:54 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:13:54 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:13:54 user nova-compute[75020]:       <nova:owner>
Nov 30 11:13:54 user nova-compute[75020]:         <nova:user uuid="74a15904d850429fab41c80e4c6631d3">tempest-TestShelveInstance-887229388-project-member</nova:user>
Nov 30 11:13:54 user nova-compute[75020]:         <nova:project uuid="02534bcb5c8949b0b023951460be4f95">tempest-TestShelveInstance-887229388</nova:project>
Nov 30 11:13:54 user nova-compute[75020]:       </nova:owner>
Nov 30 11:13:54 user nova-compute[75020]:       <nova:ports>
Nov 30 11:13:54 user nova-compute[75020]:         <nova:port uuid="a73ea525-51c4-4d2b-910f-4318eb4c6517">
Nov 30 11:13:54 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 11:13:54 user nova-compute[75020]:         </nova:port>
Nov 30 11:13:54 user nova-compute[75020]:       </nova:ports>
Nov 30 11:13:54 user nova-compute[75020]:     </nova:instance>
Nov 30 11:13:54 user nova-compute[75020]:   </metadata>
Nov 30 11:13:54 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:13:54 user nova-compute[75020]:     <system>
Nov 30 11:13:54 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:13:54 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:13:54 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:13:54 user nova-compute[75020]:       <entry name="serial">7c92477d-7202-45de-9da8-667b5f2dc168</entry>
Nov 30 11:13:54 user nova-compute[75020]:       <entry name="uuid">7c92477d-7202-45de-9da8-667b5f2dc168</entry>
Nov 30 11:13:54 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:13:54 user nova-compute[75020]:     </system>
Nov 30 11:13:54 user nova-compute[75020]:   </sysinfo>
Nov 30 11:13:54 user nova-compute[75020]:   <os>
Nov 30 11:13:54 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:13:54 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:13:54 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:13:54 user nova-compute[75020]:   </os>
Nov 30 11:13:54 user nova-compute[75020]:   <features>
Nov 30 11:13:54 user nova-compute[75020]:     <acpi/>
Nov 30 11:13:54 user nova-compute[75020]:     <apic/>
Nov 30 11:13:54 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:13:54 user nova-compute[75020]:   </features>
Nov 30 11:13:54 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:13:54 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:13:54 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:13:54 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:13:54 user nova-compute[75020]:   </clock>
Nov 30 11:13:54 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:13:54 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:13:54 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:13:54 user nova-compute[75020]:   </cpu>
Nov 30 11:13:54 user nova-compute[75020]:   <devices>
Nov 30 11:13:54 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:13:54 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:13:54 user nova-compute[75020]:       <source dev="/dev/sdc"/>
Nov 30 11:13:54 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:13:54 user nova-compute[75020]:       <serial>b054d69b-0d3c-4c2a-9f2c-6080a83967fd</serial>
Nov 30 11:13:54 user nova-compute[75020]:     </disk>
Nov 30 11:13:54 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:13:54 user nova-compute[75020]:       <mac address="fa:16:3e:9e:67:2a"/>
Nov 30 11:13:54 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:13:54 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:13:54 user nova-compute[75020]:       <target dev="tapa73ea525-51"/>
Nov 30 11:13:54 user nova-compute[75020]:     </interface>
Nov 30 11:13:54 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:13:54 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/7c92477d-7202-45de-9da8-667b5f2dc168/console.log" append="off"/>
Nov 30 11:13:54 user nova-compute[75020]:     </serial>
Nov 30 11:13:54 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:13:54 user nova-compute[75020]:     <video>
Nov 30 11:13:54 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:13:54 user nova-compute[75020]:     </video>
Nov 30 11:13:54 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:13:54 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:13:54 user nova-compute[75020]:     </rng>
Nov 30 11:13:54 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:13:54 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:13:54 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:13:54 user nova-compute[75020]:     </memballoon>
Nov 30 11:13:54 user nova-compute[75020]:   </devices>
Nov 30 11:13:54 user nova-compute[75020]: </domain>
Nov 30 11:13:54 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2019628760',display_name='tempest-TestShelveInstance-server-2019628760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2019628760',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzq3/tQkHAmTBqJ5eeS8uUPmm0fwiu9Z1MnLpnljhN1EZuTf0LCLNkVtxDajRUKBJXR1go+BfOBSi64HbRK7hdPAC5opfsidqCXoKISex/eWHUgcQYr4iZ6uAfcVeBEVA==',key_name='tempest-TestShelveInstance-1341904812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02534bcb5c8949b0b023951460be4f95',ramdisk_id='',reservation_id='r-79ialavl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-887229388',owner_user_name='tempest-TestShelveInstance-887229388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:13:43Z,user_data=None,user_id='74a15904d850429fab41c80e4c6631d3',uuid=7c92477d-7202-45de-9da8-667b5f2dc168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converting VIF {"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG os_vif [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c3748e3-b66a-5777-825e-521d910f6a24', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa73ea525-51, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa73ea525-51, col_values=(('qos', UUID('9fccb232-29a1-4c5a-89ac-6b3bbdd3b049')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa73ea525-51, col_values=(('external_ids', {'iface-id': 'a73ea525-51c4-4d2b-910f-4318eb4c6517', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:67:2a', 'vm-uuid': '7c92477d-7202-45de-9da8-667b5f2dc168'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:54 user nova-compute[75020]: INFO os_vif [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51')
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:13:54 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] No VIF found with MAC fa:16:3e:9e:67:2a, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:13:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-f64b2d3e-7453-4121-893c-4c211a62055e req-a0e4b064-c858-46e7-8706-cd557a06831e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f64b2d3e-7453-4121-893c-4c211a62055e req-a0e4b064-c858-46e7-8706-cd557a06831e service nova] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f64b2d3e-7453-4121-893c-4c211a62055e req-a0e4b064-c858-46e7-8706-cd557a06831e service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f64b2d3e-7453-4121-893c-4c211a62055e req-a0e4b064-c858-46e7-8706-cd557a06831e service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-f64b2d3e-7453-4121-893c-4c211a62055e req-a0e4b064-c858-46e7-8706-cd557a06831e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] No waiting events found dispatching network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:56 user nova-compute[75020]: WARNING nova.compute.manager [req-f64b2d3e-7453-4121-893c-4c211a62055e req-a0e4b064-c858-46e7-8706-cd557a06831e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received unexpected event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 for instance with vm_state building and task_state spawning.
Nov 30 11:13:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:13:57 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance spawned successfully.
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:13:58 user nova-compute[75020]: INFO nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 30 11:13:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:13:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-215bfb2f-23cf-46c9-92db-d3526ec3cb5e req-755f3a15-4460-4148-8cb5-39a63613487e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:13:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-215bfb2f-23cf-46c9-92db-d3526ec3cb5e req-755f3a15-4460-4148-8cb5-39a63613487e service nova] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:13:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-215bfb2f-23cf-46c9-92db-d3526ec3cb5e req-755f3a15-4460-4148-8cb5-39a63613487e service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:13:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-215bfb2f-23cf-46c9-92db-d3526ec3cb5e req-755f3a15-4460-4148-8cb5-39a63613487e service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-215bfb2f-23cf-46c9-92db-d3526ec3cb5e req-755f3a15-4460-4148-8cb5-39a63613487e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] No waiting events found dispatching network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:13:58 user nova-compute[75020]: WARNING nova.compute.manager [req-215bfb2f-23cf-46c9-92db-d3526ec3cb5e req-755f3a15-4460-4148-8cb5-39a63613487e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received unexpected event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 for instance with vm_state building and task_state spawning.
Nov 30 11:13:58 user nova-compute[75020]: INFO nova.compute.manager [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Took 15.49 seconds to build instance.
Nov 30 11:13:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-a9c14aa1-6e24-4927-8101-85540257c628 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.589s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updating instance_info_cache with network_info: [{"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:13:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:14:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Starting finish_revert_migration {{(pid=75020) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Start _get_guest_xml network_info=[{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1af6ab0c-6630-44eb-ab4a-bb63b3606191', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'edfaac3a-50a5-4b24-881e-cb5a6baedbae', 'attached_at': '2023-11-30T11:14:03.000000', 'detached_at': '', 'volume_id': 'ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'serial': 'ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:14:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:14:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:14:03 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8624MB free_disk=25.194496154785156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:14:03 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.objects.instance [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lazy-loading 'vcpu_model' on Instance uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:14:04 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:14:04 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:14:04 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5bad79-2934-40c6-b3d0-55edf9351164]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:14:04 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae60fc-eb17-4970-aa2f-dd8da43487f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a] added
Nov 30 11:14:04 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4303918f-f95f-43c1-844f-f44f70fd814d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1467f4fe-0e2f-4a2b-9aa2-106751d45b30]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyaULDIh {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyaULDIh" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ff6fb0-8c09-48bd-823c-a9e5dec11108]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fyaULDIh'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[495d4111-2161-4f43-85ef-4708f73ed09b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c7886-008c-4c0e-ad68-815c408bb0e0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:14:04 user nova-compute[75020]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:14:04 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:14:04 user nova-compute[75020]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:14:04 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance aaee883f-b87b-43c2-af7c-dfb8a7a42c05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7c92477d-7202-45de-9da8-667b5f2dc168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc167f-9c0c-466b-badc-8e879961eb45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]
Nov 30 11:14:04 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.
Nov 30 11:14:04 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[391ca36c-ae99-4e7b-85f2-edd2bfb77f26]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdfff0e-6d5c-4f56-a168-744193fbdead]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:14:04 user nova-compute[75020]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:14:04 user nova-compute[75020]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:14:04 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:14:04 user nova-compute[75020]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:14:04 user nova-compute[75020]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:14:04 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6965f13c-2958-455e-b409-4ceee616c5ee]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:14:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26235396463373734', 'path': '/dev/sdd'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235396463373734', 'path': '/dev/sdd'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:14:05 user nova-compute[75020]:   <uuid>edfaac3a-50a5-4b24-881e-cb5a6baedbae</uuid>
Nov 30 11:14:05 user nova-compute[75020]:   <name>instance-00000026</name>
Nov 30 11:14:05 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:14:05 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:14:05 user nova-compute[75020]:   <metadata>
Nov 30 11:14:05 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:14:05 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:14:05 user nova-compute[75020]:       <nova:name>tempest-ServerActionsTestOtherB-server-1598589341</nova:name>
Nov 30 11:14:05 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:14:03</nova:creationTime>
Nov 30 11:14:05 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:14:05 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:14:05 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:14:05 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:14:05 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:14:05 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:14:05 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:14:05 user nova-compute[75020]:       <nova:owner>
Nov 30 11:14:05 user nova-compute[75020]:         <nova:user uuid="5a5d2305e8d346009c88bb5324446309">tempest-ServerActionsTestOtherB-561456809-project-member</nova:user>
Nov 30 11:14:05 user nova-compute[75020]:         <nova:project uuid="f399c3a5bd2d4acf815b09df902f226c">tempest-ServerActionsTestOtherB-561456809</nova:project>
Nov 30 11:14:05 user nova-compute[75020]:       </nova:owner>
Nov 30 11:14:05 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:14:05 user nova-compute[75020]:       <nova:ports>
Nov 30 11:14:05 user nova-compute[75020]:         <nova:port uuid="503a9796-e188-4a72-a429-df54ae6acc01">
Nov 30 11:14:05 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 11:14:05 user nova-compute[75020]:         </nova:port>
Nov 30 11:14:05 user nova-compute[75020]:       </nova:ports>
Nov 30 11:14:05 user nova-compute[75020]:     </nova:instance>
Nov 30 11:14:05 user nova-compute[75020]:   </metadata>
Nov 30 11:14:05 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:14:05 user nova-compute[75020]:     <system>
Nov 30 11:14:05 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:14:05 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:14:05 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:14:05 user nova-compute[75020]:       <entry name="serial">edfaac3a-50a5-4b24-881e-cb5a6baedbae</entry>
Nov 30 11:14:05 user nova-compute[75020]:       <entry name="uuid">edfaac3a-50a5-4b24-881e-cb5a6baedbae</entry>
Nov 30 11:14:05 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:14:05 user nova-compute[75020]:     </system>
Nov 30 11:14:05 user nova-compute[75020]:   </sysinfo>
Nov 30 11:14:05 user nova-compute[75020]:   <os>
Nov 30 11:14:05 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:14:05 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:14:05 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:14:05 user nova-compute[75020]:   </os>
Nov 30 11:14:05 user nova-compute[75020]:   <features>
Nov 30 11:14:05 user nova-compute[75020]:     <acpi/>
Nov 30 11:14:05 user nova-compute[75020]:     <apic/>
Nov 30 11:14:05 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:14:05 user nova-compute[75020]:   </features>
Nov 30 11:14:05 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:14:05 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:14:05 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:14:05 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:14:05 user nova-compute[75020]:   </clock>
Nov 30 11:14:05 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:14:05 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:14:05 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:14:05 user nova-compute[75020]:   </cpu>
Nov 30 11:14:05 user nova-compute[75020]:   <devices>
Nov 30 11:14:05 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:14:05 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:14:05 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk"/>
Nov 30 11:14:05 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:14:05 user nova-compute[75020]:     </disk>
Nov 30 11:14:05 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:14:05 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:14:05 user nova-compute[75020]:       <source dev="/dev/sdd"/>
Nov 30 11:14:05 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 11:14:05 user nova-compute[75020]:       <serial>ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a</serial>
Nov 30 11:14:05 user nova-compute[75020]:     </disk>
Nov 30 11:14:05 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:14:05 user nova-compute[75020]:       <mac address="fa:16:3e:4b:ea:b1"/>
Nov 30 11:14:05 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:14:05 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:14:05 user nova-compute[75020]:       <target dev="tap503a9796-e1"/>
Nov 30 11:14:05 user nova-compute[75020]:     </interface>
Nov 30 11:14:05 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:14:05 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/console.log" append="off"/>
Nov 30 11:14:05 user nova-compute[75020]:     </serial>
Nov 30 11:14:05 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:14:05 user nova-compute[75020]:     <video>
Nov 30 11:14:05 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:14:05 user nova-compute[75020]:     </video>
Nov 30 11:14:05 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:14:05 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:14:05 user nova-compute[75020]:     </rng>
Nov 30 11:14:05 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:14:05 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:14:05 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:14:05 user nova-compute[75020]:     </memballoon>
Nov 30 11:14:05 user nova-compute[75020]:   </devices>
Nov 30 11:14:05 user nova-compute[75020]: </domain>
Nov 30 11:14:05 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG os_vif [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eab15340-2dc3-5550-928c-2770e56a2345', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap503a9796-e1, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap503a9796-e1, col_values=(('qos', UUID('5978492c-9885-4f46-93c0-48fd55404be8')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap503a9796-e1, col_values=(('external_ids', {'iface-id': '503a9796-e188-4a72-a429-df54ae6acc01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:ea:b1', 'vm-uuid': 'edfaac3a-50a5-4b24-881e-cb5a6baedbae'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:14:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:05 user nova-compute[75020]: INFO os_vif [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1')
Nov 30 11:14:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-3ec2e918-23fa-4fdc-a854-0328198c37b6 req-69ed428f-49fc-419d-ba24-f27f040e9850 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:14:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3ec2e918-23fa-4fdc-a854-0328198c37b6 req-69ed428f-49fc-419d-ba24-f27f040e9850 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3ec2e918-23fa-4fdc-a854-0328198c37b6 req-69ed428f-49fc-419d-ba24-f27f040e9850 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-3ec2e918-23fa-4fdc-a854-0328198c37b6 req-69ed428f-49fc-419d-ba24-f27f040e9850 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:06 user nova-compute[75020]: DEBUG nova.compute.manager [req-3ec2e918-23fa-4fdc-a854-0328198c37b6 req-69ed428f-49fc-419d-ba24-f27f040e9850 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:14:06 user nova-compute[75020]: WARNING nova.compute.manager [req-3ec2e918-23fa-4fdc-a854-0328198c37b6 req-69ed428f-49fc-419d-ba24-f27f040e9850 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state resized and task_state resize_reverting.
Nov 30 11:14:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:14:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:14:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:14:09 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance running successfully.
Nov 30 11:14:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] finish_revert_migration finished successfully. {{(pid=75020) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 30 11:14:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-9a2c6401-6f9e-41dc-b97e-1e19bf4a4fd1 req-7af2cb8f-d1aa-4701-a18e-5c4f75b2e9b7 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:14:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9a2c6401-6f9e-41dc-b97e-1e19bf4a4fd1 req-7af2cb8f-d1aa-4701-a18e-5c4f75b2e9b7 service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9a2c6401-6f9e-41dc-b97e-1e19bf4a4fd1 req-7af2cb8f-d1aa-4701-a18e-5c4f75b2e9b7 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9a2c6401-6f9e-41dc-b97e-1e19bf4a4fd1 req-7af2cb8f-d1aa-4701-a18e-5c4f75b2e9b7 service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:09 user nova-compute[75020]: DEBUG nova.compute.manager [req-9a2c6401-6f9e-41dc-b97e-1e19bf4a4fd1 req-7af2cb8f-d1aa-4701-a18e-5c4f75b2e9b7 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:14:09 user nova-compute[75020]: WARNING nova.compute.manager [req-9a2c6401-6f9e-41dc-b97e-1e19bf4a4fd1 req-7af2cb8f-d1aa-4701-a18e-5c4f75b2e9b7 service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state resized and task_state resize_reverting.
Nov 30 11:14:09 user nova-compute[75020]: INFO nova.compute.manager [None req-8659023c-de5a-4c2d-a04f-a57b809c9183 tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance to original state: 'active'
Nov 30 11:14:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb54ef8e-9e70-4fb4-8c96-2bed5bc717db req-d6b1729a-bc24-427a-a05a-4442d520fe36 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-changed-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb54ef8e-9e70-4fb4-8c96-2bed5bc717db req-d6b1729a-bc24-427a-a05a-4442d520fe36 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Refreshing instance network info cache due to event network-changed-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb54ef8e-9e70-4fb4-8c96-2bed5bc717db req-d6b1729a-bc24-427a-a05a-4442d520fe36 service nova] Acquiring lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb54ef8e-9e70-4fb4-8c96-2bed5bc717db req-d6b1729a-bc24-427a-a05a-4442d520fe36 service nova] Acquired lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.network.neutron [req-eb54ef8e-9e70-4fb4-8c96-2bed5bc717db req-d6b1729a-bc24-427a-a05a-4442d520fe36 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Refreshing network info cache for port cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:16 user nova-compute[75020]: INFO nova.compute.manager [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Terminating instance
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.network.neutron [req-eb54ef8e-9e70-4fb4-8c96-2bed5bc717db req-d6b1729a-bc24-427a-a05a-4442d520fe36 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updated VIF entry in instance network info cache for port cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.network.neutron [req-eb54ef8e-9e70-4fb4-8c96-2bed5bc717db req-d6b1729a-bc24-427a-a05a-4442d520fe36 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updating instance_info_cache with network_info: [{"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb54ef8e-9e70-4fb4-8c96-2bed5bc717db req-d6b1729a-bc24-427a-a05a-4442d520fe36 service nova] Releasing lock "refresh_cache-aaee883f-b87b-43c2-af7c-dfb8a7a42c05" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-8da5b269-6acc-461a-9d69-024b4f9394de req-26084e93-5f67-46ee-957f-04cdc58a36ce service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-vif-unplugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8da5b269-6acc-461a-9d69-024b4f9394de req-26084e93-5f67-46ee-957f-04cdc58a36ce service nova] Acquiring lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8da5b269-6acc-461a-9d69-024b4f9394de req-26084e93-5f67-46ee-957f-04cdc58a36ce service nova] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8da5b269-6acc-461a-9d69-024b4f9394de req-26084e93-5f67-46ee-957f-04cdc58a36ce service nova] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-8da5b269-6acc-461a-9d69-024b4f9394de req-26084e93-5f67-46ee-957f-04cdc58a36ce service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] No waiting events found dispatching network-vif-unplugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.compute.manager [req-8da5b269-6acc-461a-9d69-024b4f9394de req-26084e93-5f67-46ee-957f-04cdc58a36ce service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-vif-unplugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:14:16 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Instance destroyed successfully.
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.objects.instance [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lazy-loading 'resources' on Instance uuid aaee883f-b87b-43c2-af7c-dfb8a7a42c05 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1488346503',display_name='tempest-TestVolumeBootPattern-server-1488346503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1488346503',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaG8DO3RyufRO2Ab+v+cIj5WM2ea7v8Cx96zLGLI4ZN5Rpoz4SYEnhHgRbXyqQASzILb6McAuL3y4YQ3vkAq5gTloCj4TLWBd6Jq366DSiUViS/aE7vAzyhdW+sBfjzw==',key_name='tempest-TestVolumeBootPattern-1719612459',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:09:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c52e77c7064c97bc18c9df58ae20ef',ramdisk_id='',reservation_id='r-qlm0bc4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1120216767',owner_user_name='tempest-TestVolumeBootPattern-1120216767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:09:37Z,user_data=None,user_id='19afae8899f440c78b8a442361d5b531',uuid=aaee883f-b87b-43c2-af7c-dfb8a7a42c05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converting VIF {"id": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "address": "fa:16:3e:14:6e:54", "network": {"id": "b78a97aa-5a6b-417c-aed3-c6f4a8350d81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530807474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c52e77c7064c97bc18c9df58ae20ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e92cc-28", "ovs_interfaceid": "cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e92cc-28') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG os_vif [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e92cc-28') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc3e92cc-28, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bf3db55-aa87-4820-a6e9-d58df3e6d89e) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:14:16 user nova-compute[75020]: INFO os_vif [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a,network=Network(b78a97aa-5a6b-417c-aed3-c6f4a8350d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e92cc-28')
Nov 30 11:14:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZItoOes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:14:16 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:14:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:14:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea913a9-8787-47fa-ba43-504c3f7df42b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:14:17 user nova-compute[75020]: No targets found.
Nov 30 11:14:17 user nova-compute[75020]: iSNS:
Nov 30 11:14:17 user nova-compute[75020]: No targets found.
Nov 30 11:14:17 user nova-compute[75020]: STATIC:
Nov 30 11:14:17 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:14:17 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:14:17 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:14:17 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e
Nov 30 11:14:17 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:14:17 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:14:17 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd
Nov 30 11:14:17 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:14:17 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:14:17 user nova-compute[75020]: FIRMWARE:
Nov 30 11:14:17 user nova-compute[75020]: No targets found.
Nov 30 11:14:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:14:17 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:14:17 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[917a6fa2-19f5-4033-9908-8ba6886ffb90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b9cf60-4939-47ba-b614-47fbdf8e9d71]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:14:17 user nova-compute[75020]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:14:17 user nova-compute[75020]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:14:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e (non-flash)
Nov 30 11:14:17 user nova-compute[75020]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:14:17 user nova-compute[75020]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:14:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada875e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd74d29-5b52-4ff4-b225-0e3e5722fee0]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb7c1dd-404f-4ca3-b093-b00970590053]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0013024-4064-4959-9b47-b3397a09a40b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[792850f7-12bc-44b0-95d6-a450af86f44c]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[406b273d-5886-424c-b0d3-75111438f9f8]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d3dcc5-ccf8-4ff6-82e4-1919a76cb356]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260]
Nov 30 11:14:17 user nova-compute[75020]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e, portal: 172.16.0.220,3260] successful.
Nov 30 11:14:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02160fe3-2891-461b-85c9-8a92451ef62e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[211c6249-3069-41e1-8eec-4103ea72df24]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] <== disconnect_volume: return (316ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:14:17 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Deleting instance files /opt/stack/data/nova/instances/aaee883f-b87b-43c2-af7c-dfb8a7a42c05_del
Nov 30 11:14:17 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Deletion of /opt/stack/data/nova/instances/aaee883f-b87b-43c2-af7c-dfb8a7a42c05_del complete
Nov 30 11:14:17 user nova-compute[75020]: INFO nova.compute.manager [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 30 11:14:17 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:14:17 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:14:17 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Took 0.44 seconds to deallocate network for instance.
Nov 30 11:14:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-ed39c743-0c66-4897-9ff3-41347ed46174 req-763cb19d-431c-4d3e-be2f-45f74be862b8 service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-vif-deleted-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-afb4d20f-bed6-4f04-9e91-8031a2dc66cb req-fefb00e5-24a6-45b9-9780-97583bf5694e service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received event network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-afb4d20f-bed6-4f04-9e91-8031a2dc66cb req-fefb00e5-24a6-45b9-9780-97583bf5694e service nova] Acquiring lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-afb4d20f-bed6-4f04-9e91-8031a2dc66cb req-fefb00e5-24a6-45b9-9780-97583bf5694e service nova] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-afb4d20f-bed6-4f04-9e91-8031a2dc66cb req-fefb00e5-24a6-45b9-9780-97583bf5694e service nova] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG nova.compute.manager [req-afb4d20f-bed6-4f04-9e91-8031a2dc66cb req-fefb00e5-24a6-45b9-9780-97583bf5694e service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] No waiting events found dispatching network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:14:18 user nova-compute[75020]: WARNING nova.compute.manager [req-afb4d20f-bed6-4f04-9e91-8031a2dc66cb req-fefb00e5-24a6-45b9-9780-97583bf5694e service nova] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Received unexpected event network-vif-plugged-cc3e92cc-2880-42a4-8ef5-f1ec18ac1f0a for instance with vm_state active and task_state deleting.
Nov 30 11:14:18 user nova-compute[75020]: INFO nova.compute.manager [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] [instance: aaee883f-b87b-43c2-af7c-dfb8a7a42c05] Took 0.85 seconds to detach 1 volumes for instance.
Nov 30 11:14:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:14:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:18 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Deleted allocations for instance aaee883f-b87b-43c2-af7c-dfb8a7a42c05
Nov 30 11:14:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-69c3aee4-67a0-449c-92ca-2f9a58a9cf69 tempest-TestVolumeBootPattern-1120216767 tempest-TestVolumeBootPattern-1120216767-project-member] Lock "aaee883f-b87b-43c2-af7c-dfb8a7a42c05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.819s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:22 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:14:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:14:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid dc17dce7-e1b2-4f40-b5a6-036a56e5aaad {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:14:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:55 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:14:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:14:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:14:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:14:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:14:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:14:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:01 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:15:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:15:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:15:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:06 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:15:06 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=25.184024810791016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7c92477d-7202-45de-9da8-667b5f2dc168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:15:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:15:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:15:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:15:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:15:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:15:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:15:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:15:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-797033bb-b8c2-4085-92f1-a97a48716aaf req-23cae5b8-29d0-4216-9f01-2300e894855e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:15:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-797033bb-b8c2-4085-92f1-a97a48716aaf req-23cae5b8-29d0-4216-9f01-2300e894855e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing instance network info cache due to event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:15:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-797033bb-b8c2-4085-92f1-a97a48716aaf req-23cae5b8-29d0-4216-9f01-2300e894855e service nova] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:15:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-797033bb-b8c2-4085-92f1-a97a48716aaf req-23cae5b8-29d0-4216-9f01-2300e894855e service nova] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:15:34 user nova-compute[75020]: DEBUG nova.network.neutron [req-797033bb-b8c2-4085-92f1-a97a48716aaf req-23cae5b8-29d0-4216-9f01-2300e894855e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:15:35 user nova-compute[75020]: DEBUG nova.network.neutron [req-797033bb-b8c2-4085-92f1-a97a48716aaf req-23cae5b8-29d0-4216-9f01-2300e894855e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updated VIF entry in instance network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:15:35 user nova-compute[75020]: DEBUG nova.network.neutron [req-797033bb-b8c2-4085-92f1-a97a48716aaf req-23cae5b8-29d0-4216-9f01-2300e894855e service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:15:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-797033bb-b8c2-4085-92f1-a97a48716aaf req-23cae5b8-29d0-4216-9f01-2300e894855e service nova] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:15:36 user nova-compute[75020]: INFO nova.compute.manager [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Shelve offloading
Nov 30 11:15:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-9b93883f-db8b-4da6-9428-73d481ad9dca req-e874302a-6dd1-48af-8a3f-12efa9ccc430 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-unplugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9b93883f-db8b-4da6-9428-73d481ad9dca req-e874302a-6dd1-48af-8a3f-12efa9ccc430 service nova] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9b93883f-db8b-4da6-9428-73d481ad9dca req-e874302a-6dd1-48af-8a3f-12efa9ccc430 service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9b93883f-db8b-4da6-9428-73d481ad9dca req-e874302a-6dd1-48af-8a3f-12efa9ccc430 service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-9b93883f-db8b-4da6-9428-73d481ad9dca req-e874302a-6dd1-48af-8a3f-12efa9ccc430 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] No waiting events found dispatching network-vif-unplugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:15:36 user nova-compute[75020]: WARNING nova.compute.manager [req-9b93883f-db8b-4da6-9428-73d481ad9dca req-e874302a-6dd1-48af-8a3f-12efa9ccc430 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received unexpected event network-vif-unplugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 for instance with vm_state active and task_state shelving.
Nov 30 11:15:36 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance destroyed successfully.
Nov 30 11:15:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:15:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'flavor' on Instance uuid dc17dce7-e1b2-4f40-b5a6-036a56e5aaad {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:15:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Ignoring supplied device name: /dev/vdb
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG nova.network.neutron [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:15:37 user nova-compute[75020]: INFO nova.compute.manager [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Attaching volume 497aa8df-7582-437d-b770-b1dfc6268442 to /dev/vdb
Nov 30 11:15:37 user nova-compute[75020]: DEBUG os_brick.utils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9cdb09-85eb-42c0-8005-ef13c2aab209]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a210ab31-7402-4cd5-8ffa-f9e0de18d90d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f6949-4ed8-47bc-ba2e-c374f41255da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb87d2a5-16f7-491b-8545-d092c05a9537]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:15:37 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:15:37 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4798066-1986-477a-900c-28db06bf4d88]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG os_brick.utils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:15:37 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Updating existing volume attachment record: e3ee73a8-3794-4718-89fe-107863390dae {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:15:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance destroyed successfully.
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.objects.instance [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lazy-loading 'resources' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2019628760',display_name='tempest-TestShelveInstance-server-2019628760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2019628760',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzq3/tQkHAmTBqJ5eeS8uUPmm0fwiu9Z1MnLpnljhN1EZuTf0LCLNkVtxDajRUKBJXR1go+BfOBSi64HbRK7hdPAC5opfsidqCXoKISex/eWHUgcQYr4iZ6uAfcVeBEVA==',key_name='tempest-TestShelveInstance-1341904812',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02534bcb5c8949b0b023951460be4f95',ramdisk_id='',reservation_id='r-79ialavl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-887229388',owner_user_name='tempest-TestShelveInstance-887229388-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:13:58Z,user_data=None,user_id='74a15904d850429fab41c80e4c6631d3',uuid=7c92477d-7202-45de-9da8-667b5f2dc168,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converting VIF {"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_vif [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73ea525-51, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-7fa150e4-e783-4a05-ab50-53bf3ca76f88 req-47296de7-5602-4c4b-b1fd-45ab942b459c service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-7fa150e4-e783-4a05-ab50-53bf3ca76f88 req-47296de7-5602-4c4b-b1fd-45ab942b459c service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing instance network info cache due to event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7fa150e4-e783-4a05-ab50-53bf3ca76f88 req-47296de7-5602-4c4b-b1fd-45ab942b459c service nova] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7fa150e4-e783-4a05-ab50-53bf3ca76f88 req-47296de7-5602-4c4b-b1fd-45ab942b459c service nova] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-7fa150e4-e783-4a05-ab50-53bf3ca76f88 req-47296de7-5602-4c4b-b1fd-45ab942b459c service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fccb232-29a1-4c5a-89ac-6b3bbdd3b049) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:15:38 user nova-compute[75020]: INFO os_vif [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51')
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpVIUtcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:15:38 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[74336138-146f-40a6-a792-025ca4f6a5d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:15:38 user nova-compute[75020]: No targets found.
Nov 30 11:15:38 user nova-compute[75020]: iSNS:
Nov 30 11:15:38 user nova-compute[75020]: No targets found.
Nov 30 11:15:38 user nova-compute[75020]: STATIC:
Nov 30 11:15:38 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:15:38 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:15:38 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:15:38 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd
Nov 30 11:15:38 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:15:38 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:15:38 user nova-compute[75020]: FIRMWARE:
Nov 30 11:15:38 user nova-compute[75020]: No targets found.
Nov 30 11:15:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:15:38 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:15:38 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d9418c-0895-4838-a2aa-a82e5a8f897b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a49646-c88c-49c7-814c-c889f4d4dc23]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:15:38 user nova-compute[75020]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:15:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:15:38 user nova-compute[75020]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:15:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada85ffc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd0d6fe-f807-4ec7-83f0-a63e36ad5324]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9015d2-ad15-4b91-99c5-4197c4c5891b]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7272f598-7e42-4857-a1f9-55f5488229ef]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21bfda7-2759-4055-b3f4-3f43730a09ce]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[51257e4d-c36a-4bb9-b271-a9c8107ecfda]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc884a8-29b1-4da5-a3e5-e9c1e2a51130]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260]
Nov 30 11:15:38 user nova-compute[75020]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260] successful.
Nov 30 11:15:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b391dd29-cf5b-45da-83a2-76a202ae2993]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] <== disconnect_volume: return (291ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:15:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Deleting instance files /opt/stack/data/nova/instances/7c92477d-7202-45de-9da8-667b5f2dc168_del
Nov 30 11:15:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Deletion of /opt/stack/data/nova/instances/7c92477d-7202-45de-9da8-667b5f2dc168_del complete
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] No waiting events found dispatching network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:15:38 user nova-compute[75020]: WARNING nova.compute.manager [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received unexpected event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 for instance with vm_state active and task_state shelving.
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received event network-changed-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Refreshing instance network info cache due to event network-changed-78f47b07-a204-475d-8dc9-47dd762f1ce0. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] Acquiring lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] Acquired lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Refreshing network info cache for port 78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-7fa150e4-e783-4a05-ab50-53bf3ca76f88 req-47296de7-5602-4c4b-b1fd-45ab942b459c service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updated VIF entry in instance network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-7fa150e4-e783-4a05-ab50-53bf3ca76f88 req-47296de7-5602-4c4b-b1fd-45ab942b459c service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": null, "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa73ea525-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:15:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7fa150e4-e783-4a05-ab50-53bf3ca76f88 req-47296de7-5602-4c4b-b1fd-45ab942b459c service nova] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:15:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Updated VIF entry in instance network info cache for port 78f47b07-a204-475d-8dc9-47dd762f1ce0. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:15:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Updating instance_info_cache with network_info: [{"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:15:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-06f78a6e-b8d2-488d-9591-f19db24f9311 req-f3c9cd2c-8abe-44cd-9f4b-ae2e382f519b service nova] Releasing lock "refresh_cache-dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:15:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:39 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Deleted allocations for instance 7c92477d-7202-45de-9da8-667b5f2dc168
Nov 30 11:15:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:15:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:15:40 user nova-compute[75020]: DEBUG nova.objects.instance [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:15:40 user nova-compute[75020]: DEBUG nova.objects.base [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Object Instance<7c92477d-7202-45de-9da8-667b5f2dc168> lazy-loaded attributes: resources,numa_topology {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:15:40 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:15:40 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:15:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:15:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-728a9980-ba0c-488a-abd5-b55d33809768 tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.170s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:15:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcVQeqKt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:15:46 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:15:46 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:15:46 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b5a00d-1971-4196-bf66-01f904f97f5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:15:46 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a2323e-0d76-4d83-9c79-85382dbbd009]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442] added
Nov 30 11:15:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[173e6d08-8bea-4774-84ae-2fd2a3bfea4d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde0d3d5-d5a9-444f-840f-df56cff7e413]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcVQeqKt {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcVQeqKt" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcae042-51ef-41cd-b14d-d628b488afd4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcVQeqKt'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4972af8f-3bde-49b0-832c-9542fb4c8b57]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[143e929c-ffd5-48cc-913e-780750f204aa]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:15:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:15:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffecf7a6-742d-4355-8bf9-fac771178897]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442, portal: 172.16.0.220,3260]
Nov 30 11:15:46 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442, portal: 172.16.0.220,3260] successful.
Nov 30 11:15:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe2a982-26ea-45f4-90f2-0f922771c5f7]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d39f8ec-9c27-455d-bf95-2476755d9808]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:15:46 user nova-compute[75020]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 (non-flash)
Nov 30 11:15:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:15:46 user nova-compute[75020]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 (non-flash)
Nov 30 11:15:46 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[de10812b-2d07-47c0-b189-9fcaf4c4f265]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:15:46 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:15:47 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:15:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcVQeqKt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:15:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:15:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23365346465623931', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:15:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365346465623931', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:15:47 user nova-compute[75020]: DEBUG nova.objects.instance [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'flavor' on Instance uuid dc17dce7-e1b2-4f40-b5a6-036a56e5aaad {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:15:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:15:47 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:15:47 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:15:47 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:15:47 user nova-compute[75020]:   <serial>497aa8df-7582-437d-b770-b1dfc6268442</serial>
Nov 30 11:15:47 user nova-compute[75020]: </disk>
Nov 30 11:15:47 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:15:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:15:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:15:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] No VIF found with MAC fa:16:3e:86:ab:e5, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:15:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-49bea3ff-7b6d-47bb-a88f-c912b45477e1 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.702s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:15:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:15:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:15:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:15:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [{"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-edfaac3a-50a5-4b24-881e-cb5a6baedbae" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:16:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:16:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:16:06 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:16:06 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:16:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.18181610107422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance edfaac3a-50a5-4b24-881e-cb5a6baedbae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:16:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:16:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:09 user nova-compute[75020]: INFO nova.compute.manager [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Detaching volume 497aa8df-7582-437d-b770-b1dfc6268442
Nov 30 11:16:09 user nova-compute[75020]: INFO nova.virt.block_device [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Attempting to driver detach volume 497aa8df-7582-437d-b770-b1dfc6268442 from mountpoint /dev/vdb
Nov 30 11:16:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Attempting to detach device vdb from instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:16:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:16:09 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:16:09 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:16:09 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:16:09 user nova-compute[75020]:   <serial>497aa8df-7582-437d-b770-b1dfc6268442</serial>
Nov 30 11:16:09 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:16:09 user nova-compute[75020]: </disk>
Nov 30 11:16:09 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:16:09 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Successfully detached device vdb from instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad from the persistent domain config.
Nov 30 11:16:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:16:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:16:09 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:16:09 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:16:09 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:16:09 user nova-compute[75020]:   <serial>497aa8df-7582-437d-b770-b1dfc6268442</serial>
Nov 30 11:16:09 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:16:09 user nova-compute[75020]: </disk>
Nov 30 11:16:09 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:16:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:16:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:16:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:16:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:16:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:30 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad is timed out.
Nov 30 11:16:30 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Successfully detached device vdb from instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad from the live domain config.
Nov 30 11:16:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcVQeqKt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:16:30 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[defae58f-562d-41a4-9319-2c615bbee339]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:16:30 user nova-compute[75020]: No targets found.
Nov 30 11:16:30 user nova-compute[75020]: iSNS:
Nov 30 11:16:30 user nova-compute[75020]: No targets found.
Nov 30 11:16:30 user nova-compute[75020]: STATIC:
Nov 30 11:16:30 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:16:30 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:16:30 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:16:30 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442
Nov 30 11:16:30 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:16:30 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:16:30 user nova-compute[75020]: FIRMWARE:
Nov 30 11:16:30 user nova-compute[75020]: No targets found.
Nov 30 11:16:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:16:30 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:16:30 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fbb7a2-2e48-44a0-ae9b-76c20f41bace]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf302816-3869-418e-8e55-39d19fe627ad]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:16:30 user nova-compute[75020]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 (non-flash)
Nov 30 11:16:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:16:30 user nova-compute[75020]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 (non-flash)
Nov 30 11:16:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada853e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf70b9ad-dcac-438f-957f-033ac58546cc]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[604b9f96-4f09-4e18-85b9-bb740106c7b4]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[70681e7f-7d75-4ea7-bfb4-71ecc8eed752]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a381fff-23c5-484c-9d34-35afa85e70bb]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c021f618-0d46-4577-b7fd-67056dfc94fa]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db256b1-f17c-4e28-8453-3a54f256d1b5]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442, portal: 172.16.0.220,3260]
Nov 30 11:16:30 user nova-compute[75020]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442, portal: 172.16.0.220,3260] successful.
Nov 30 11:16:30 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[972a93d5-b998-4a77-abec-070232588d8a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] <== disconnect_volume: return (276ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:16:30 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG nova.objects.instance [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'flavor' on Instance uuid dc17dce7-e1b2-4f40-b5a6-036a56e5aaad {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-660d7539-9754-4e6e-9ae9-6de7d092ffa6 tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.498s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:31 user nova-compute[75020]: INFO nova.compute.manager [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Terminating instance
Nov 30 11:16:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-bd66b1ba-f64e-45fe-bb8c-0a4454095f12 req-48e64e4b-a326-42c2-b6b9-f7e04d2e1450 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received event network-vif-unplugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bd66b1ba-f64e-45fe-bb8c-0a4454095f12 req-48e64e4b-a326-42c2-b6b9-f7e04d2e1450 service nova] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bd66b1ba-f64e-45fe-bb8c-0a4454095f12 req-48e64e4b-a326-42c2-b6b9-f7e04d2e1450 service nova] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-bd66b1ba-f64e-45fe-bb8c-0a4454095f12 req-48e64e4b-a326-42c2-b6b9-f7e04d2e1450 service nova] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-bd66b1ba-f64e-45fe-bb8c-0a4454095f12 req-48e64e4b-a326-42c2-b6b9-f7e04d2e1450 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] No waiting events found dispatching network-vif-unplugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG nova.compute.manager [req-bd66b1ba-f64e-45fe-bb8c-0a4454095f12 req-48e64e4b-a326-42c2-b6b9-f7e04d2e1450 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received event network-vif-unplugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:16:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:32 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Instance destroyed successfully.
Nov 30 11:16:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lazy-loading 'resources' on Instance uuid dc17dce7-e1b2-4f40-b5a6-036a56e5aaad {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-118273757',display_name='tempest-VolumesSnapshotTestJSON-instance-118273757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-118273757',id=44,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX+0R5Jtog8OXeLY4gjWfv1TEatY//oQD02CQuTdNbmwxeSBfkV2051d9JCsSrJycwG/uTawNjn8sheeJVJrLvhevtOMdQTfuBMyYOG7vE0BalosngF0Im9mmZouTcW1A==',key_name='tempest-keypair-1505637640',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:13:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d6e6289c12e4cc4a4eceb1fb34af2f0',ramdisk_id='',reservation_id='r-unem32q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2088929526',owner_user_name='tempest-VolumesSnapshotTestJSON-2088929526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26bab64764c4697bc01cf6ac0b6b8dc',uuid=dc17dce7-e1b2-4f40-b5a6-036a56e5aaad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converting VIF {"id": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "address": "fa:16:3e:86:ab:e5", "network": {"id": "959d198c-eb27-4f23-ac59-582c1a5ac822", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1030018785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6e6289c12e4cc4a4eceb1fb34af2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f47b07-a2", "ovs_interfaceid": "78f47b07-a204-475d-8dc9-47dd762f1ce0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:ab:e5,bridge_name='br-int',has_traffic_filtering=True,id=78f47b07-a204-475d-8dc9-47dd762f1ce0,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f47b07-a2') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_vif [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:ab:e5,bridge_name='br-int',has_traffic_filtering=True,id=78f47b07-a204-475d-8dc9-47dd762f1ce0,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f47b07-a2') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78f47b07-a2, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d400e312-33e9-49a4-bd08-4dcaf1a97ce5) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:32 user nova-compute[75020]: INFO os_vif [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:ab:e5,bridge_name='br-int',has_traffic_filtering=True,id=78f47b07-a204-475d-8dc9-47dd762f1ce0,network=Network(959d198c-eb27-4f23-ac59-582c1a5ac822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f47b07-a2')
Nov 30 11:16:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcVQeqKt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:16:32 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[19071cdb-2cce-4346-9132-a04d25b123f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:16:32 user nova-compute[75020]: No targets found.
Nov 30 11:16:32 user nova-compute[75020]: iSNS:
Nov 30 11:16:32 user nova-compute[75020]: No targets found.
Nov 30 11:16:32 user nova-compute[75020]: STATIC:
Nov 30 11:16:32 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:16:32 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:16:32 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:16:32 user nova-compute[75020]: FIRMWARE:
Nov 30 11:16:32 user nova-compute[75020]: No targets found.
Nov 30 11:16:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:16:32 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:16:32 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497aa8df-7582-437d-b770-b1dfc6268442', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[22458881-7313-4be4-a9f7-6ca12fb09bec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7240280c-eb26-4edf-be2a-966137ef1891]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:16:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:16:32 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad885ffbe0>, {}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Disconnecting from: [] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] <== disconnect_volume: return (70ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:16:32 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Deleting instance files /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad_del
Nov 30 11:16:32 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Deletion of /opt/stack/data/nova/instances/dc17dce7-e1b2-4f40-b5a6-036a56e5aaad_del complete
Nov 30 11:16:32 user nova-compute[75020]: INFO nova.compute.manager [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 11:16:32 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:16:32 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:16:33 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Took 1.14 seconds to deallocate network for instance.
Nov 30 11:16:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-415b35a6-ce6c-4fb0-a66f-48654953509d req-d3ac6d7a-f931-495d-b77c-bee9f47a1247 service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received event network-vif-deleted-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:33 user nova-compute[75020]: WARNING nova.volume.cinder [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Attachment e3ee73a8-3794-4718-89fe-107863390dae does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e3ee73a8-3794-4718-89fe-107863390dae. (HTTP 404) (Request-ID: req-9540fe53-7e6f-4c99-b03d-7e40f818dae8)
Nov 30 11:16:33 user nova-compute[75020]: INFO nova.compute.manager [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Took 0.02 seconds to detach 1 volumes for instance.
Nov 30 11:16:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-f87d6c37-dd3b-4de5-8a17-47658d3704f8 req-2571986b-807c-497c-a790-b8cb9b0293bb service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received event network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f87d6c37-dd3b-4de5-8a17-47658d3704f8 req-2571986b-807c-497c-a790-b8cb9b0293bb service nova] Acquiring lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f87d6c37-dd3b-4de5-8a17-47658d3704f8 req-2571986b-807c-497c-a790-b8cb9b0293bb service nova] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f87d6c37-dd3b-4de5-8a17-47658d3704f8 req-2571986b-807c-497c-a790-b8cb9b0293bb service nova] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:33 user nova-compute[75020]: DEBUG nova.compute.manager [req-f87d6c37-dd3b-4de5-8a17-47658d3704f8 req-2571986b-807c-497c-a790-b8cb9b0293bb service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] No waiting events found dispatching network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:16:33 user nova-compute[75020]: WARNING nova.compute.manager [req-f87d6c37-dd3b-4de5-8a17-47658d3704f8 req-2571986b-807c-497c-a790-b8cb9b0293bb service nova] [instance: dc17dce7-e1b2-4f40-b5a6-036a56e5aaad] Received unexpected event network-vif-plugged-78f47b07-a204-475d-8dc9-47dd762f1ce0 for instance with vm_state deleted and task_state None.
Nov 30 11:16:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:33 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Deleted allocations for instance dc17dce7-e1b2-4f40-b5a6-036a56e5aaad
Nov 30 11:16:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4b223ed8-108f-4d6a-8dc6-b5b31a2ccb6c tempest-VolumesSnapshotTestJSON-2088929526 tempest-VolumesSnapshotTestJSON-2088929526-project-member] Lock "dc17dce7-e1b2-4f40-b5a6-036a56e5aaad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.457s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:41 user nova-compute[75020]: INFO nova.compute.manager [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Terminating instance
Nov 30 11:16:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-f3f9cac3-66f2-45e5-9c6e-174392fbaa67 req-058d1de0-7768-43f5-aaf7-c08f82f4aebf service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f3f9cac3-66f2-45e5-9c6e-174392fbaa67 req-058d1de0-7768-43f5-aaf7-c08f82f4aebf service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f3f9cac3-66f2-45e5-9c6e-174392fbaa67 req-058d1de0-7768-43f5-aaf7-c08f82f4aebf service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f3f9cac3-66f2-45e5-9c6e-174392fbaa67 req-058d1de0-7768-43f5-aaf7-c08f82f4aebf service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-f3f9cac3-66f2-45e5-9c6e-174392fbaa67 req-058d1de0-7768-43f5-aaf7-c08f82f4aebf service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-f3f9cac3-66f2-45e5-9c6e-174392fbaa67 req-058d1de0-7768-43f5-aaf7-c08f82f4aebf service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:16:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Instance destroyed successfully.
Nov 30 11:16:42 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lazy-loading 'resources' on Instance uuid edfaac3a-50a5-4b24-881e-cb5a6baedbae {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1598589341',display_name='tempest-ServerActionsTestOtherB-server-1598589341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1598589341',id=38,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrebLNn3RvJsczpUzfEBbPYjceq4HPQCFMxgQGzLhzOjMjtaoR66QPie1dSmjwJZ4syrcioYqFQCqaXUskE0VC++mWdZ3YtnnKm7sr8D6g3eqBcvfRPsCy3dS7+E+/D5w==',key_name='tempest-keypair-1515067728',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f399c3a5bd2d4acf815b09df902f226c',ramdisk_id='',reservation_id='r-6n5aqfs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-561456809',owner_user_name='tempest-ServerActionsTestOtherB-561456809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5d2305e8d346009c88bb5324446309',uuid=edfaac3a-50a5-4b24-881e-cb5a6baedbae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converting VIF {"id": "503a9796-e188-4a72-a429-df54ae6acc01", "address": "fa:16:3e:4b:ea:b1", "network": {"id": "413ac5a5-84db-4589-aefe-c6ad37bb3b94", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1223602415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f399c3a5bd2d4acf815b09df902f226c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap503a9796-e1", "ovs_interfaceid": "503a9796-e188-4a72-a429-df54ae6acc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_vif [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap503a9796-e1, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5978492c-9885-4f46-93c0-48fd55404be8) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: INFO os_vif [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=503a9796-e188-4a72-a429-df54ae6acc01,network=Network(413ac5a5-84db-4589-aefe-c6ad37bb3b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503a9796-e1')
Nov 30 11:16:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyaULDIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:16:42 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b1731d-660f-4a8e-b6a3-88621ef2d477]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:16:42 user nova-compute[75020]: No targets found.
Nov 30 11:16:42 user nova-compute[75020]: iSNS:
Nov 30 11:16:42 user nova-compute[75020]: No targets found.
Nov 30 11:16:42 user nova-compute[75020]: STATIC:
Nov 30 11:16:42 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a
Nov 30 11:16:42 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:16:42 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:16:42 user nova-compute[75020]: FIRMWARE:
Nov 30 11:16:42 user nova-compute[75020]: No targets found.
Nov 30 11:16:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:16:42 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:16:42 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d89db63-aec3-40f9-a774-93d70707736a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff1bf6-89f9-4b0c-ad84-dd3e83ac0b3e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:16:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a (non-flash)
Nov 30 11:16:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadb9b4f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a'): ({'sdd'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Removing single pathed devices sdd {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9832305-e1db-4efe-a3fc-7cb8b6f69411]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f009fe66-45a1-4028-a402-e0d1a4e2378c]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Flushing IO for device /dev/sdd {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c5bf6a-eecd-4094-9d2f-9d9bde5c4ac9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63612b6-dc8b-406c-af3a-aa6158503821]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] SCSI volumes sdd have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[df320e52-ab60-4f1d-b576-11e978ca9cea]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec40bbb-b9cd-4c6c-8d88-70d2ee14b80d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260]
Nov 30 11:16:42 user nova-compute[75020]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a, portal: 172.16.0.220,3260] successful.
Nov 30 11:16:42 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7ad550-b7ca-4cbd-a2b6-ad046764dd1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5b6ede-fcda-4c20-af8b-2f6946cf898d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] <== disconnect_volume: return (314ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:16:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Deleting instance files /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae_del
Nov 30 11:16:42 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Deletion of /opt/stack/data/nova/instances/edfaac3a-50a5-4b24-881e-cb5a6baedbae_del complete
Nov 30 11:16:42 user nova-compute[75020]: INFO nova.compute.manager [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 30 11:16:42 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:16:43 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Took 0.98 seconds to deallocate network for instance.
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:16:43 user nova-compute[75020]: WARNING nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state active and task_state deleting.
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:16:43 user nova-compute[75020]: WARNING nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state active and task_state deleting.
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:16:43 user nova-compute[75020]: WARNING nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state active and task_state deleting.
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-unplugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Acquiring lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] No waiting events found dispatching network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:16:43 user nova-compute[75020]: WARNING nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received unexpected event network-vif-plugged-503a9796-e188-4a72-a429-df54ae6acc01 for instance with vm_state active and task_state deleting.
Nov 30 11:16:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-db5a0ba6-e58b-4e59-9743-a6a70b6832b7 req-9bd8240e-7baa-4313-a021-4e5c0d88c13f service nova] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Received event network-vif-deleted-503a9796-e188-4a72-a429-df54ae6acc01 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:16:44 user nova-compute[75020]: INFO nova.compute.manager [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] [instance: edfaac3a-50a5-4b24-881e-cb5a6baedbae] Took 0.77 seconds to detach 1 volumes for instance.
Nov 30 11:16:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:16:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:16:44 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:16:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:16:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:44 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Deleted allocations for instance edfaac3a-50a5-4b24-881e-cb5a6baedbae
Nov 30 11:16:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ae2892e-075d-4242-8aeb-799f9f37a30d tempest-ServerActionsTestOtherB-561456809 tempest-ServerActionsTestOtherB-561456809-project-member] Lock "edfaac3a-50a5-4b24-881e-cb5a6baedbae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.291s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:16:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:55 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:16:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:16:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:16:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:16:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:16:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:16:59 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:17:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:17:03 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:17:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:17:06 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:17:06 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:17:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9072MB free_disk=25.236427307128906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:17:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:17:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:17:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:17:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:17:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:17:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:17:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:17:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:28 user nova-compute[75020]: INFO nova.compute.manager [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Unshelving
Nov 30 11:17:28 user nova-compute[75020]: INFO nova.virt.block_device [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Booting with volume b054d69b-0d3c-4c2a-9f2c-6080a83967fd at /dev/vda
Nov 30 11:17:28 user nova-compute[75020]: DEBUG os_brick.utils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e56aee-f387-4a66-826c-247501c89d1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a22169d-a236-4abf-9ed3-30913dba3ebc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c0c244-6930-49b2-803d-2bf56e45ba24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaf824b-1e32-4fb6-bedd-f0b33b43b397]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:17:28 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:17:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[89580142-a999-4710-bde8-dbd16cea316b]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG os_brick.utils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:17:28 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating existing volume attachment record: dcf83fc9-6421-44a2-89c7-af5ac11ef937 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:17:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lazy-loading 'pci_requests' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:17:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:17:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:17:37 user nova-compute[75020]: INFO nova.compute.claims [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Claim successful on node user
Nov 30 11:17:37 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:17:37 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:17:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:17:37 user nova-compute[75020]: INFO nova.network.neutron [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating port a73ea525-51c4-4d2b-910f-4318eb4c6517 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.network.neutron [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-8f18ef1d-acad-48fd-8305-c372996aa2b2 req-9ddec24a-f668-47c4-9b06-d2caee467e83 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-8f18ef1d-acad-48fd-8305-c372996aa2b2 req-9ddec24a-f668-47c4-9b06-d2caee467e83 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing instance network info cache due to event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8f18ef1d-acad-48fd-8305-c372996aa2b2 req-9ddec24a-f668-47c4-9b06-d2caee467e83 service nova] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.network.neutron [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:17:38 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Creating image(s)
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Ensure instance console log exists: /opt/stack/data/nova/instances/7c92477d-7202-45de-9da8-667b5f2dc168/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Start _get_guest_xml network_info=[{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'dcf83fc9-6421-44a2-89c7-af5ac11ef937', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpVIUtcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c92477d-7202-45de-9da8-667b5f2dc168', 'attached_at': '', 'detached_at': '', 'volume_id': 'b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'serial': 'b054d69b-0d3c-4c2a-9f2c-6080a83967fd'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8f18ef1d-acad-48fd-8305-c372996aa2b2 req-9ddec24a-f668-47c4-9b06-d2caee467e83 service nova] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-8f18ef1d-acad-48fd-8305-c372996aa2b2 req-9ddec24a-f668-47c4-9b06-d2caee467e83 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:17:38 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:17:38 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.objects.instance [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.objects.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Object Instance<7c92477d-7202-45de-9da8-667b5f2dc168> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpVIUtcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:17:38 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:17:38 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:17:38 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a800b-5cf7-4920-a0eb-b9a3e7b07114]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:17:38 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b880db-3e3f-4fe2-89a9-acffa9d53eb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd] added
Nov 30 11:17:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[028a4107-6a26-424a-abec-39cff874605b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b99315-86c0-4c25-baf9-2c6ef0bd8ac6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DpVIUtcb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DpVIUtcb" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e251778-3eee-49d3-9685-b71563448a65]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DpVIUtcb'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19d5a35-6c21-46e3-afaa-3dcf7aae84f3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b71631-de18-49fc-91b7-765e0afb7831]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:17:38 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:17:38 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:17:38 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:17:38 user nova-compute[75020]: 
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cbe4c2-028a-4e8a-ad23-d31b0196a816]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260]
Nov 30 11:17:38 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260] successful.
Nov 30 11:17:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dceac2d-ee59-46b7-9155-e90c8a4f6021]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e26a937-fbad-4de5-93d8-db5996df9c2b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:17:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:17:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[46651d63-f837-4603-8342-76ee2afbffa3]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-8f18ef1d-acad-48fd-8305-c372996aa2b2 req-9ddec24a-f668-47c4-9b06-d2caee467e83 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updated VIF entry in instance network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-8f18ef1d-acad-48fd-8305-c372996aa2b2 req-9ddec24a-f668-47c4-9b06-d2caee467e83 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8f18ef1d-acad-48fd-8305-c372996aa2b2 req-9ddec24a-f668-47c4-9b06-d2caee467e83 service nova] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpVIUtcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23130636230646261', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130636230646261', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T11:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2019628760',display_name='tempest-TestShelveInstance-server-2019628760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2019628760',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1341904812',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='02534bcb5c8949b0b023951460be4f95',ramdisk_id='',reservation_id='r-79ialavl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-887229388',owner_user_name='tempest-TestShelveInstance-887229388-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:17:28Z,user_data=None,user_id='74a15904d850429fab41c80e4c6631d3',uuid=7c92477d-7202-45de-9da8-667b5f2dc168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converting VIF {"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.objects.base [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Object Instance<7c92477d-7202-45de-9da8-667b5f2dc168> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:17:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:17:39 user nova-compute[75020]:   <uuid>7c92477d-7202-45de-9da8-667b5f2dc168</uuid>
Nov 30 11:17:39 user nova-compute[75020]:   <name>instance-0000002b</name>
Nov 30 11:17:39 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:17:39 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:17:39 user nova-compute[75020]:   <metadata>
Nov 30 11:17:39 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:17:39 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:17:39 user nova-compute[75020]:       <nova:name>tempest-TestShelveInstance-server-2019628760</nova:name>
Nov 30 11:17:39 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:17:38</nova:creationTime>
Nov 30 11:17:39 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:17:39 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:17:39 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:17:39 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:17:39 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:17:39 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:17:39 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:17:39 user nova-compute[75020]:       <nova:owner>
Nov 30 11:17:39 user nova-compute[75020]:         <nova:user uuid="74a15904d850429fab41c80e4c6631d3">tempest-TestShelveInstance-887229388-project-member</nova:user>
Nov 30 11:17:39 user nova-compute[75020]:         <nova:project uuid="02534bcb5c8949b0b023951460be4f95">tempest-TestShelveInstance-887229388</nova:project>
Nov 30 11:17:39 user nova-compute[75020]:       </nova:owner>
Nov 30 11:17:39 user nova-compute[75020]:       <nova:ports>
Nov 30 11:17:39 user nova-compute[75020]:         <nova:port uuid="a73ea525-51c4-4d2b-910f-4318eb4c6517">
Nov 30 11:17:39 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 11:17:39 user nova-compute[75020]:         </nova:port>
Nov 30 11:17:39 user nova-compute[75020]:       </nova:ports>
Nov 30 11:17:39 user nova-compute[75020]:     </nova:instance>
Nov 30 11:17:39 user nova-compute[75020]:   </metadata>
Nov 30 11:17:39 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:17:39 user nova-compute[75020]:     <system>
Nov 30 11:17:39 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:17:39 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:17:39 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:17:39 user nova-compute[75020]:       <entry name="serial">7c92477d-7202-45de-9da8-667b5f2dc168</entry>
Nov 30 11:17:39 user nova-compute[75020]:       <entry name="uuid">7c92477d-7202-45de-9da8-667b5f2dc168</entry>
Nov 30 11:17:39 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:17:39 user nova-compute[75020]:     </system>
Nov 30 11:17:39 user nova-compute[75020]:   </sysinfo>
Nov 30 11:17:39 user nova-compute[75020]:   <os>
Nov 30 11:17:39 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:17:39 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:17:39 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:17:39 user nova-compute[75020]:   </os>
Nov 30 11:17:39 user nova-compute[75020]:   <features>
Nov 30 11:17:39 user nova-compute[75020]:     <acpi/>
Nov 30 11:17:39 user nova-compute[75020]:     <apic/>
Nov 30 11:17:39 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:17:39 user nova-compute[75020]:   </features>
Nov 30 11:17:39 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:17:39 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:17:39 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:17:39 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:17:39 user nova-compute[75020]:   </clock>
Nov 30 11:17:39 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:17:39 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:17:39 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:17:39 user nova-compute[75020]:   </cpu>
Nov 30 11:17:39 user nova-compute[75020]:   <devices>
Nov 30 11:17:39 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:17:39 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:17:39 user nova-compute[75020]:       <source dev="/dev/sdb"/>
Nov 30 11:17:39 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:17:39 user nova-compute[75020]:       <serial>b054d69b-0d3c-4c2a-9f2c-6080a83967fd</serial>
Nov 30 11:17:39 user nova-compute[75020]:     </disk>
Nov 30 11:17:39 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:17:39 user nova-compute[75020]:       <mac address="fa:16:3e:9e:67:2a"/>
Nov 30 11:17:39 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:17:39 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:17:39 user nova-compute[75020]:       <target dev="tapa73ea525-51"/>
Nov 30 11:17:39 user nova-compute[75020]:     </interface>
Nov 30 11:17:39 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:17:39 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/7c92477d-7202-45de-9da8-667b5f2dc168/console.log" append="off"/>
Nov 30 11:17:39 user nova-compute[75020]:     </serial>
Nov 30 11:17:39 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:17:39 user nova-compute[75020]:     <video>
Nov 30 11:17:39 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:17:39 user nova-compute[75020]:     </video>
Nov 30 11:17:39 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:17:39 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:17:39 user nova-compute[75020]:     </rng>
Nov 30 11:17:39 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:17:39 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:17:39 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:17:39 user nova-compute[75020]:     </memballoon>
Nov 30 11:17:39 user nova-compute[75020]:   </devices>
Nov 30 11:17:39 user nova-compute[75020]: </domain>
Nov 30 11:17:39 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T11:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2019628760',display_name='tempest-TestShelveInstance-server-2019628760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2019628760',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1341904812',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='02534bcb5c8949b0b023951460be4f95',ramdisk_id='',reservation_id='r-79ialavl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-887229388',owner_user_name='tempest-TestShelveInstance-887229388-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:17:28Z,user_data=None,user_id='74a15904d850429fab41c80e4c6631d3',uuid=7c92477d-7202-45de-9da8-667b5f2dc168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converting VIF {"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG os_vif [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c3748e3-b66a-5777-825e-521d910f6a24', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa73ea525-51, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa73ea525-51, col_values=(('qos', UUID('6c1a30bb-b6f9-4f20-867f-4a56708f5804')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa73ea525-51, col_values=(('external_ids', {'iface-id': 'a73ea525-51c4-4d2b-910f-4318eb4c6517', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:67:2a', 'vm-uuid': '7c92477d-7202-45de-9da8-667b5f2dc168'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:40 user nova-compute[75020]: INFO os_vif [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51')
Nov 30 11:17:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:17:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] No VIF found with MAC fa:16:3e:9e:67:2a, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-9cbf4a25-1d50-4326-bffe-74d68ecfbbf2 req-90362dcf-75a4-4c22-9b7b-fe4733ae1ecb service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9cbf4a25-1d50-4326-bffe-74d68ecfbbf2 req-90362dcf-75a4-4c22-9b7b-fe4733ae1ecb service nova] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9cbf4a25-1d50-4326-bffe-74d68ecfbbf2 req-90362dcf-75a4-4c22-9b7b-fe4733ae1ecb service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9cbf4a25-1d50-4326-bffe-74d68ecfbbf2 req-90362dcf-75a4-4c22-9b7b-fe4733ae1ecb service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:17:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-9cbf4a25-1d50-4326-bffe-74d68ecfbbf2 req-90362dcf-75a4-4c22-9b7b-fe4733ae1ecb service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] No waiting events found dispatching network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:17:41 user nova-compute[75020]: WARNING nova.compute.manager [req-9cbf4a25-1d50-4326-bffe-74d68ecfbbf2 req-90362dcf-75a4-4c22-9b7b-fe4733ae1ecb service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received unexpected event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 11:17:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:17:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:17:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance spawned successfully.
Nov 30 11:17:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:17:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-534b8a65-2ed8-4e5b-bfee-e4789ff5abaf tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.788s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:17:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-19060413-4e6c-48fd-abfb-80f1583bce3b req-07cc645f-a763-4d53-a3bc-9ebe53696fb5 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:17:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-19060413-4e6c-48fd-abfb-80f1583bce3b req-07cc645f-a763-4d53-a3bc-9ebe53696fb5 service nova] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-19060413-4e6c-48fd-abfb-80f1583bce3b req-07cc645f-a763-4d53-a3bc-9ebe53696fb5 service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-19060413-4e6c-48fd-abfb-80f1583bce3b req-07cc645f-a763-4d53-a3bc-9ebe53696fb5 service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:17:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-19060413-4e6c-48fd-abfb-80f1583bce3b req-07cc645f-a763-4d53-a3bc-9ebe53696fb5 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] No waiting events found dispatching network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:17:43 user nova-compute[75020]: WARNING nova.compute.manager [req-19060413-4e6c-48fd-abfb-80f1583bce3b req-07cc645f-a763-4d53-a3bc-9ebe53696fb5 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received unexpected event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 for instance with vm_state active and task_state None.
Nov 30 11:17:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:55 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:57 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:17:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:17:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:17:57 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:17:57 user nova-compute[75020]: INFO nova.compute.claims [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Claim successful on node user
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:17:58 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:17:58 user nova-compute[75020]: INFO nova.virt.block_device [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Booting with volume 12d64181-c08e-46a9-be2c-8240f7e7d007 at /dev/vda
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.policy [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f61351b3f1d41418b0bfdde96f6f006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b71837281e6a4d4f805d5f166a1bf5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG os_brick.utils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b82b353-3b3e-427d-9a99-3179bf834525]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[770ac1cb-8930-476f-bb7a-b4f4e960513e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa025b8-2ed9-4fc4-8c46-410408c1c64f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cace8e-4719-4caf-9263-a3f4a085c9b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:17:58 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:17:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aef4fa7-d76e-40ac-a5eb-b1cce7235096]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG os_brick.utils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updating existing volume attachment record: 4906f0c2-fb99-479e-accb-5dbaf7298c83 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:17:58 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Successfully created port: 9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Successfully updated port: 9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquired lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-a9d7ce5f-f86b-426d-8cec-81687cce5625 req-53a511d3-09fc-4307-b06f-f3120d0de4fa service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-changed-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-a9d7ce5f-f86b-426d-8cec-81687cce5625 req-53a511d3-09fc-4307-b06f-f3120d0de4fa service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Refreshing instance network info cache due to event network-changed-9bc84dc6-9697-416e-b83e-52c492bf96f0. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9d7ce5f-f86b-426d-8cec-81687cce5625 req-53a511d3-09fc-4307-b06f-f3120d0de4fa service nova] Acquiring lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:17:59 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG nova.network.neutron [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updating instance_info_cache with network_info: [{"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Releasing lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance network_info: |[{"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9d7ce5f-f86b-426d-8cec-81687cce5625 req-53a511d3-09fc-4307-b06f-f3120d0de4fa service nova] Acquired lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG nova.network.neutron [req-a9d7ce5f-f86b-426d-8cec-81687cce5625 req-53a511d3-09fc-4307-b06f-f3120d0de4fa service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Refreshing network info cache for port 9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG nova.network.neutron [req-a9d7ce5f-f86b-426d-8cec-81687cce5625 req-53a511d3-09fc-4307-b06f-f3120d0de4fa service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updated VIF entry in instance network info cache for port 9bc84dc6-9697-416e-b83e-52c492bf96f0. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG nova.network.neutron [req-a9d7ce5f-f86b-426d-8cec-81687cce5625 req-53a511d3-09fc-4307-b06f-f3120d0de4fa service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updating instance_info_cache with network_info: [{"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:18:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a9d7ce5f-f86b-426d-8cec-81687cce5625 req-53a511d3-09fc-4307-b06f-f3120d0de4fa service nova] Releasing lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:18:01 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Skipping network cache update for instance because it is Building. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:18:05 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:18:07 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:18:07 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.22449493408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7c92477d-7202-45de-9da8-667b5f2dc168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance ea2b0016-c978-4551-a3fb-afdf0e555ade actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:18:07 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Creating image(s)
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Ensure instance console log exists: /opt/stack/data/nova/instances/ea2b0016-c978-4551-a3fb-afdf0e555ade/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Start _get_guest_xml network_info=[{"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '4906f0c2-fb99-479e-accb-5dbaf7298c83', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea2b0016-c978-4551-a3fb-afdf0e555ade', 'attached_at': '', 'detached_at': '', 'volume_id': '12d64181-c08e-46a9-be2c-8240f7e7d007', 'serial': '12d64181-c08e-46a9-be2c-8240f7e7d007'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:18:07 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:18:07 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:18:07 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:18:07 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:18:07 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92acba9-91d1-4431-a10e-2e042c427734]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:18:07 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb42f454-35da-45e4-bdef-b7adf20c21cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007] added
Nov 30 11:18:07 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0b0862-8e99-4009-88a7-091be54abcfa]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[167c28e6-7d94-4eef-a3e9-a3ca34b256a3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSPLgXtA {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSPLgXtA" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c547fe3f-5d33-4a50-aa5f-eef9d38f75c2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSPLgXtA'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff05f7-287d-48cd-b7cc-5f2525f80079]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[976b9a88-561d-4901-9b36-a37b723c4261]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:18:08 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:18:08 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[da785e1b-f79d-46b3-acec-7a0ddc8535dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260]
Nov 30 11:18:08 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260] successful.
Nov 30 11:18:08 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a91bb3-f60c-4b18-bf5c-d012129f351f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6425304-7d27-43ff-b2d7-2a50bb6e03db]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:18:08 user nova-compute[75020]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:18:08 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:18:08 user nova-compute[75020]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:18:08 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5de823-7f16-45d6-9cbc-2fec7f16d140]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26532333132386434', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532333132386434', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1514584792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1514584792',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXPjfkBRJpSIcBRhTukbhPBs+vNX8ctFYJkFsQVOyShGpNKWXVeAlmyBWuXkKceEULoYUNEjDYbVX7e4GK2ScN8E64laeCq9Tscp+sAsYHJ5fAGynYRlC67gm3mbzoow==',key_name='tempest-keypair-300189641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b71837281e6a4d4f805d5f166a1bf5dd',ramdisk_id='',reservation_id='r-024yr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-182363408',owner_user_name='tempest-ServerActionsV293TestJSON-182363408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f61351b3f1d41418b0bfdde96f6f006',uuid=ea2b0016-c978-4551-a3fb-afdf0e555ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converting VIF {"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lazy-loading 'pci_devices' on Instance uuid ea2b0016-c978-4551-a3fb-afdf0e555ade {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:18:09 user nova-compute[75020]:   <uuid>ea2b0016-c978-4551-a3fb-afdf0e555ade</uuid>
Nov 30 11:18:09 user nova-compute[75020]:   <name>instance-0000002d</name>
Nov 30 11:18:09 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:18:09 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:18:09 user nova-compute[75020]:   <metadata>
Nov 30 11:18:09 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:18:09 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:18:09 user nova-compute[75020]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1514584792</nova:name>
Nov 30 11:18:09 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:18:07</nova:creationTime>
Nov 30 11:18:09 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:18:09 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:18:09 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:18:09 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:18:09 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:18:09 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:18:09 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:18:09 user nova-compute[75020]:       <nova:owner>
Nov 30 11:18:09 user nova-compute[75020]:         <nova:user uuid="0f61351b3f1d41418b0bfdde96f6f006">tempest-ServerActionsV293TestJSON-182363408-project-member</nova:user>
Nov 30 11:18:09 user nova-compute[75020]:         <nova:project uuid="b71837281e6a4d4f805d5f166a1bf5dd">tempest-ServerActionsV293TestJSON-182363408</nova:project>
Nov 30 11:18:09 user nova-compute[75020]:       </nova:owner>
Nov 30 11:18:09 user nova-compute[75020]:       <nova:ports>
Nov 30 11:18:09 user nova-compute[75020]:         <nova:port uuid="9bc84dc6-9697-416e-b83e-52c492bf96f0">
Nov 30 11:18:09 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 11:18:09 user nova-compute[75020]:         </nova:port>
Nov 30 11:18:09 user nova-compute[75020]:       </nova:ports>
Nov 30 11:18:09 user nova-compute[75020]:     </nova:instance>
Nov 30 11:18:09 user nova-compute[75020]:   </metadata>
Nov 30 11:18:09 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:18:09 user nova-compute[75020]:     <system>
Nov 30 11:18:09 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:18:09 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:18:09 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:18:09 user nova-compute[75020]:       <entry name="serial">ea2b0016-c978-4551-a3fb-afdf0e555ade</entry>
Nov 30 11:18:09 user nova-compute[75020]:       <entry name="uuid">ea2b0016-c978-4551-a3fb-afdf0e555ade</entry>
Nov 30 11:18:09 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:18:09 user nova-compute[75020]:     </system>
Nov 30 11:18:09 user nova-compute[75020]:   </sysinfo>
Nov 30 11:18:09 user nova-compute[75020]:   <os>
Nov 30 11:18:09 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:18:09 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:18:09 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:18:09 user nova-compute[75020]:   </os>
Nov 30 11:18:09 user nova-compute[75020]:   <features>
Nov 30 11:18:09 user nova-compute[75020]:     <acpi/>
Nov 30 11:18:09 user nova-compute[75020]:     <apic/>
Nov 30 11:18:09 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:18:09 user nova-compute[75020]:   </features>
Nov 30 11:18:09 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:18:09 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:18:09 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:18:09 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:18:09 user nova-compute[75020]:   </clock>
Nov 30 11:18:09 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:18:09 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:18:09 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:18:09 user nova-compute[75020]:   </cpu>
Nov 30 11:18:09 user nova-compute[75020]:   <devices>
Nov 30 11:18:09 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:18:09 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:18:09 user nova-compute[75020]:       <source dev="/dev/sdc"/>
Nov 30 11:18:09 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:18:09 user nova-compute[75020]:       <serial>12d64181-c08e-46a9-be2c-8240f7e7d007</serial>
Nov 30 11:18:09 user nova-compute[75020]:     </disk>
Nov 30 11:18:09 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:18:09 user nova-compute[75020]:       <mac address="fa:16:3e:af:4a:f1"/>
Nov 30 11:18:09 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:18:09 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:18:09 user nova-compute[75020]:       <target dev="tap9bc84dc6-96"/>
Nov 30 11:18:09 user nova-compute[75020]:     </interface>
Nov 30 11:18:09 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:18:09 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/ea2b0016-c978-4551-a3fb-afdf0e555ade/console.log" append="off"/>
Nov 30 11:18:09 user nova-compute[75020]:     </serial>
Nov 30 11:18:09 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:18:09 user nova-compute[75020]:     <video>
Nov 30 11:18:09 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:18:09 user nova-compute[75020]:     </video>
Nov 30 11:18:09 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:18:09 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:18:09 user nova-compute[75020]:     </rng>
Nov 30 11:18:09 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:18:09 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:18:09 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:18:09 user nova-compute[75020]:     </memballoon>
Nov 30 11:18:09 user nova-compute[75020]:   </devices>
Nov 30 11:18:09 user nova-compute[75020]: </domain>
Nov 30 11:18:09 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1514584792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1514584792',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXPjfkBRJpSIcBRhTukbhPBs+vNX8ctFYJkFsQVOyShGpNKWXVeAlmyBWuXkKceEULoYUNEjDYbVX7e4GK2ScN8E64laeCq9Tscp+sAsYHJ5fAGynYRlC67gm3mbzoow==',key_name='tempest-keypair-300189641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b71837281e6a4d4f805d5f166a1bf5dd',ramdisk_id='',reservation_id='r-024yr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-182363408',owner_user_name='tempest-ServerActionsV293TestJSON-182363408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f61351b3f1d41418b0bfdde96f6f006',uuid=ea2b0016-c978-4551-a3fb-afdf0e555ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converting VIF {"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG os_vif [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd39ca291-3d9b-5d9d-9c37-002e2827d262', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bc84dc6-96, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bc84dc6-96, col_values=(('qos', UUID('49c61f47-c8b5-44c9-b8e4-e90b9bc9368a')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bc84dc6-96, col_values=(('external_ids', {'iface-id': '9bc84dc6-9697-416e-b83e-52c492bf96f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:4a:f1', 'vm-uuid': 'ea2b0016-c978-4551-a3fb-afdf0e555ade'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:09 user nova-compute[75020]: INFO os_vif [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96')
Nov 30 11:18:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:18:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] No VIF found with MAC fa:16:3e:af:4a:f1, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:18:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-8384dd77-4229-41b5-a605-2d8c443f43f9 req-1b969581-8a77-41c0-9af7-30df77216fc5 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:18:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8384dd77-4229-41b5-a605-2d8c443f43f9 req-1b969581-8a77-41c0-9af7-30df77216fc5 service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:18:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8384dd77-4229-41b5-a605-2d8c443f43f9 req-1b969581-8a77-41c0-9af7-30df77216fc5 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:18:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8384dd77-4229-41b5-a605-2d8c443f43f9 req-1b969581-8a77-41c0-9af7-30df77216fc5 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:18:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-8384dd77-4229-41b5-a605-2d8c443f43f9 req-1b969581-8a77-41c0-9af7-30df77216fc5 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] No waiting events found dispatching network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:18:10 user nova-compute[75020]: WARNING nova.compute.manager [req-8384dd77-4229-41b5-a605-2d8c443f43f9 req-1b969581-8a77-41c0-9af7-30df77216fc5 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received unexpected event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 for instance with vm_state building and task_state spawning.
Nov 30 11:18:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:18:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance spawned successfully.
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:18:12 user nova-compute[75020]: INFO nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:18:12 user nova-compute[75020]: INFO nova.compute.manager [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Took 14.95 seconds to build instance.
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-a08dc1ce-7a7a-4fef-a59a-0cbba077f8b6 req-b9489336-4ac4-490c-8ad8-e1e50d632676 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a08dc1ce-7a7a-4fef-a59a-0cbba077f8b6 req-b9489336-4ac4-490c-8ad8-e1e50d632676 service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a08dc1ce-7a7a-4fef-a59a-0cbba077f8b6 req-b9489336-4ac4-490c-8ad8-e1e50d632676 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a08dc1ce-7a7a-4fef-a59a-0cbba077f8b6 req-b9489336-4ac4-490c-8ad8-e1e50d632676 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:18:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-a08dc1ce-7a7a-4fef-a59a-0cbba077f8b6 req-b9489336-4ac4-490c-8ad8-e1e50d632676 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] No waiting events found dispatching network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:18:12 user nova-compute[75020]: WARNING nova.compute.manager [req-a08dc1ce-7a7a-4fef-a59a-0cbba077f8b6 req-b9489336-4ac4-490c-8ad8-e1e50d632676 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received unexpected event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 for instance with vm_state active and task_state None.
Nov 30 11:18:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f28aae8-8d5c-49cd-a8fe-7a851f0743d0 tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.050s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:18:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:18:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:18:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:18:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:00 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:19:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:19:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:19:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:19:06 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:19:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:09 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:19:09 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=25.222618103027344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7c92477d-7202-45de-9da8-667b5f2dc168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance ea2b0016-c978-4551-a3fb-afdf0e555ade actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:19:09 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:19:10 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:19:10 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:19:10 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:19:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:19:11 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:19:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:19:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:19:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:19:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-b4e34e9e-13b3-4037-8030-0e7035fba4e2 req-4cd25ba0-d254-4dec-8d03-7175ba4c7678 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-b4e34e9e-13b3-4037-8030-0e7035fba4e2 req-4cd25ba0-d254-4dec-8d03-7175ba4c7678 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing instance network info cache due to event network-changed-a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b4e34e9e-13b3-4037-8030-0e7035fba4e2 req-4cd25ba0-d254-4dec-8d03-7175ba4c7678 service nova] Acquiring lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b4e34e9e-13b3-4037-8030-0e7035fba4e2 req-4cd25ba0-d254-4dec-8d03-7175ba4c7678 service nova] Acquired lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-b4e34e9e-13b3-4037-8030-0e7035fba4e2 req-4cd25ba0-d254-4dec-8d03-7175ba4c7678 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Refreshing network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:19 user nova-compute[75020]: INFO nova.compute.manager [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Terminating instance
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.compute.manager [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-24248d78-0489-4eed-b046-00208954b712 req-1ab1c543-407a-4a5c-95cb-1af20661bf95 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-unplugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-24248d78-0489-4eed-b046-00208954b712 req-1ab1c543-407a-4a5c-95cb-1af20661bf95 service nova] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-24248d78-0489-4eed-b046-00208954b712 req-1ab1c543-407a-4a5c-95cb-1af20661bf95 service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-24248d78-0489-4eed-b046-00208954b712 req-1ab1c543-407a-4a5c-95cb-1af20661bf95 service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-24248d78-0489-4eed-b046-00208954b712 req-1ab1c543-407a-4a5c-95cb-1af20661bf95 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] No waiting events found dispatching network-vif-unplugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-24248d78-0489-4eed-b046-00208954b712 req-1ab1c543-407a-4a5c-95cb-1af20661bf95 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-unplugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-b4e34e9e-13b3-4037-8030-0e7035fba4e2 req-4cd25ba0-d254-4dec-8d03-7175ba4c7678 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updated VIF entry in instance network info cache for port a73ea525-51c4-4d2b-910f-4318eb4c6517. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-b4e34e9e-13b3-4037-8030-0e7035fba4e2 req-4cd25ba0-d254-4dec-8d03-7175ba4c7678 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [{"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-b4e34e9e-13b3-4037-8030-0e7035fba4e2 req-4cd25ba0-d254-4dec-8d03-7175ba4c7678 service nova] Releasing lock "refresh_cache-7c92477d-7202-45de-9da8-667b5f2dc168" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Instance destroyed successfully.
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.objects.instance [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lazy-loading 'resources' on Instance uuid 7c92477d-7202-45de-9da8-667b5f2dc168 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T11:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2019628760',display_name='tempest-TestShelveInstance-server-2019628760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2019628760',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzq3/tQkHAmTBqJ5eeS8uUPmm0fwiu9Z1MnLpnljhN1EZuTf0LCLNkVtxDajRUKBJXR1go+BfOBSi64HbRK7hdPAC5opfsidqCXoKISex/eWHUgcQYr4iZ6uAfcVeBEVA==',key_name='tempest-TestShelveInstance-1341904812',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02534bcb5c8949b0b023951460be4f95',ramdisk_id='',reservation_id='r-79ialavl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-887229388',owner_user_name='tempest-TestShelveInstance-887229388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:17:44Z,user_data=None,user_id='74a15904d850429fab41c80e4c6631d3',uuid=7c92477d-7202-45de-9da8-667b5f2dc168,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converting VIF {"id": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "address": "fa:16:3e:9e:67:2a", "network": {"id": "232e0ac4-0245-42de-8805-23fde640bb63", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046031218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02534bcb5c8949b0b023951460be4f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73ea525-51", "ovs_interfaceid": "a73ea525-51c4-4d2b-910f-4318eb4c6517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_vif [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73ea525-51, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c1a30bb-b6f9-4f20-867f-4a56708f5804) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:19 user nova-compute[75020]: INFO os_vif [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:67:2a,bridge_name='br-int',has_traffic_filtering=True,id=a73ea525-51c4-4d2b-910f-4318eb4c6517,network=Network(232e0ac4-0245-42de-8805-23fde640bb63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73ea525-51')
Nov 30 11:19:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DpVIUtcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:19:19 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e51e5e-3746-40db-8b52-cc554c2fd0e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:19:19 user nova-compute[75020]: No targets found.
Nov 30 11:19:19 user nova-compute[75020]: iSNS:
Nov 30 11:19:19 user nova-compute[75020]: No targets found.
Nov 30 11:19:19 user nova-compute[75020]: STATIC:
Nov 30 11:19:19 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007
Nov 30 11:19:19 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:19:19 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:19:19 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd
Nov 30 11:19:19 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:19:19 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:19:19 user nova-compute[75020]: FIRMWARE:
Nov 30 11:19:19 user nova-compute[75020]: No targets found.
Nov 30 11:19:19 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:19:19 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:19:19 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b6b93-7d28-47a5-8054-b71c0999156f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee700e-fd17-4f9a-ac1b-e7e42cbebb1a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:19:19 user nova-compute[75020]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:19:19 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd (non-flash)
Nov 30 11:19:19 user nova-compute[75020]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:19:19 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad8860ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[13632c35-a588-4ec8-8960-d2c37445f7fd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2b068d-7ba0-4b5e-ac80-2ab1b9229992]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:19:19 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed69fb7b-fd51-429e-849d-600e358d1ad9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.192s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84904788-53d1-4b69-bc27-fa87325283ce]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23130636230646261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_444809fb', '/dev/disk/by-id/scsi-1SCST_BIO444809fb-10cb0dba5b7274df') {{(pid=86371) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a31c3b-0dc6-4664-92ff-015d655e60d4]: (4, None) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee32960-11f3-46c6-96e0-a750d05de9cf]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[411a975a-f6eb-45e5-9403-5c79ac970f33]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260]
Nov 30 11:19:20 user nova-compute[75020]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd, portal: 172.16.0.220,3260] successful.
Nov 30 11:19:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b054d69b-0d3c-4c2a-9f2c-6080a83967fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d8a0ae-ff29-4463-9993-45d47b55227a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] <== disconnect_volume: return (446ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:19:20 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Deleting instance files /opt/stack/data/nova/instances/7c92477d-7202-45de-9da8-667b5f2dc168_del
Nov 30 11:19:20 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Deletion of /opt/stack/data/nova/instances/7c92477d-7202-45de-9da8-667b5f2dc168_del complete
Nov 30 11:19:20 user nova-compute[75020]: INFO nova.compute.manager [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 30 11:19:20 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:19:20 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:19:20 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Took 0.38 seconds to deallocate network for instance.
Nov 30 11:19:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-03c505e9-2b53-46ed-a930-c0c8c4c6f5e7 req-c3f3da3c-8abf-46a7-ae6d-f2d0592807a3 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-deleted-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-d0708d18-c3c8-4895-a904-cd8bbd1969a0 req-eb1ad492-5364-42dc-9306-bc9451d5b3a0 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0708d18-c3c8-4895-a904-cd8bbd1969a0 req-eb1ad492-5364-42dc-9306-bc9451d5b3a0 service nova] Acquiring lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0708d18-c3c8-4895-a904-cd8bbd1969a0 req-eb1ad492-5364-42dc-9306-bc9451d5b3a0 service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0708d18-c3c8-4895-a904-cd8bbd1969a0 req-eb1ad492-5364-42dc-9306-bc9451d5b3a0 service nova] Lock "7c92477d-7202-45de-9da8-667b5f2dc168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG nova.compute.manager [req-d0708d18-c3c8-4895-a904-cd8bbd1969a0 req-eb1ad492-5364-42dc-9306-bc9451d5b3a0 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] No waiting events found dispatching network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:19:21 user nova-compute[75020]: WARNING nova.compute.manager [req-d0708d18-c3c8-4895-a904-cd8bbd1969a0 req-eb1ad492-5364-42dc-9306-bc9451d5b3a0 service nova] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Received unexpected event network-vif-plugged-a73ea525-51c4-4d2b-910f-4318eb4c6517 for instance with vm_state active and task_state deleting.
Nov 30 11:19:21 user nova-compute[75020]: INFO nova.compute.manager [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Took 0.82 seconds to detach 1 volumes for instance.
Nov 30 11:19:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] [instance: 7c92477d-7202-45de-9da8-667b5f2dc168] Deleting volume: b054d69b-0d3c-4c2a-9f2c-6080a83967fd {{(pid=75020) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:19:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:21 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Deleted allocations for instance 7c92477d-7202-45de-9da8-667b5f2dc168
Nov 30 11:19:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-ab830367-f2ce-4b5d-a5ab-c7beeff4859d tempest-TestShelveInstance-887229388 tempest-TestShelveInstance-887229388-project-member] Lock "7c92477d-7202-45de-9da8-667b5f2dc168" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.936s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:19:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:19:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:19:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:19:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:19:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-1b17abe9-f87f-47f2-8b62-5b925ad57df1 req-4ab4959c-be5f-4015-a10b-5663cf447510 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-changed-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-1b17abe9-f87f-47f2-8b62-5b925ad57df1 req-4ab4959c-be5f-4015-a10b-5663cf447510 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Refreshing instance network info cache due to event network-changed-9bc84dc6-9697-416e-b83e-52c492bf96f0. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1b17abe9-f87f-47f2-8b62-5b925ad57df1 req-4ab4959c-be5f-4015-a10b-5663cf447510 service nova] Acquiring lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1b17abe9-f87f-47f2-8b62-5b925ad57df1 req-4ab4959c-be5f-4015-a10b-5663cf447510 service nova] Acquired lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-1b17abe9-f87f-47f2-8b62-5b925ad57df1 req-4ab4959c-be5f-4015-a10b-5663cf447510 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Refreshing network info cache for port 9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-1b17abe9-f87f-47f2-8b62-5b925ad57df1 req-4ab4959c-be5f-4015-a10b-5663cf447510 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updated VIF entry in instance network info cache for port 9bc84dc6-9697-416e-b83e-52c492bf96f0. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-1b17abe9-f87f-47f2-8b62-5b925ad57df1 req-4ab4959c-be5f-4015-a10b-5663cf447510 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updating instance_info_cache with network_info: [{"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1b17abe9-f87f-47f2-8b62-5b925ad57df1 req-4ab4959c-be5f-4015-a10b-5663cf447510 service nova] Releasing lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:19:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:50 user nova-compute[75020]: INFO nova.compute.manager [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Rebuilding instance
Nov 30 11:19:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-a8ff0d90-f557-4d28-9b50-07616bc4fd52 req-48b73efa-4077-477f-8030-40881da204f2 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-unplugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a8ff0d90-f557-4d28-9b50-07616bc4fd52 req-48b73efa-4077-477f-8030-40881da204f2 service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a8ff0d90-f557-4d28-9b50-07616bc4fd52 req-48b73efa-4077-477f-8030-40881da204f2 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-a8ff0d90-f557-4d28-9b50-07616bc4fd52 req-48b73efa-4077-477f-8030-40881da204f2 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-a8ff0d90-f557-4d28-9b50-07616bc4fd52 req-48b73efa-4077-477f-8030-40881da204f2 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] No waiting events found dispatching network-vif-unplugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:19:50 user nova-compute[75020]: WARNING nova.compute.manager [req-a8ff0d90-f557-4d28-9b50-07616bc4fd52 req-48b73efa-4077-477f-8030-40881da204f2 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received unexpected event network-vif-unplugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 for instance with vm_state active and task_state rebuilding.
Nov 30 11:19:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance destroyed successfully.
Nov 30 11:19:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance destroyed successfully.
Nov 30 11:19:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1791572744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1514584792',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXPjfkBRJpSIcBRhTukbhPBs+vNX8ctFYJkFsQVOyShGpNKWXVeAlmyBWuXkKceEULoYUNEjDYbVX7e4GK2ScN8E64laeCq9Tscp+sAsYHJ5fAGynYRlC67gm3mbzoow==',key_name='tempest-keypair-300189641',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b71837281e6a4d4f805d5f166a1bf5dd',ramdisk_id='',reservation_id='r-024yr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-182363408',owner_user_name='tempest-ServerActionsV293TestJSON-182363408-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:19:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f61351b3f1d41418b0bfdde96f6f006',uuid=ea2b0016-c978-4551-a3fb-afdf0e555ade,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converting VIF {"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_vif [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bc84dc6-96, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49c61f47-c8b5-44c9-b8e4-e90b9bc9368a) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:19:51 user nova-compute[75020]: INFO os_vif [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96')
Nov 30 11:19:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:19:51 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[50858340-d18b-4c29-b183-88268b258599]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:19:51 user nova-compute[75020]: No targets found.
Nov 30 11:19:51 user nova-compute[75020]: iSNS:
Nov 30 11:19:51 user nova-compute[75020]: No targets found.
Nov 30 11:19:51 user nova-compute[75020]: STATIC:
Nov 30 11:19:51 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007
Nov 30 11:19:51 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:19:51 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:19:51 user nova-compute[75020]: FIRMWARE:
Nov 30 11:19:51 user nova-compute[75020]: No targets found.
Nov 30 11:19:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:19:51 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:19:51 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ccec52-965b-4604-948b-4bc97423d335]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f822fe76-ef6f-4612-83cc-6e0c9345f57b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:19:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:19:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad887d5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f9fcb-38ac-401d-8ac2-f6a50761fca0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df3a164-9acd-4712-a763-6743993026e3]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b538d7-8240-4adb-9555-a499e8cda58f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa862a2-886b-494f-bb65-55bd33690d85]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7d3697db', '/dev/disk/by-id/scsi-1SCST_BIO7d3697db-e23128d407624f99', '/dev/disk/by-id/scsi-26532333132386434') {{(pid=86371) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c616c05-328c-4113-8255-e393fceb6c56]: (4, None) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c9a2a-696d-433b-a3c3-33dda9ddc511]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8034bfc4-4d36-4b92-b344-b28c64cf2d61]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260]
Nov 30 11:19:51 user nova-compute[75020]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260] successful.
Nov 30 11:19:51 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac47dfb-ce81-4abf-b692-0d16f31dad9a]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] <== disconnect_volume: return (293ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:19:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Deleting instance files /opt/stack/data/nova/instances/ea2b0016-c978-4551-a3fb-afdf0e555ade_del
Nov 30 11:19:51 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Deletion of /opt/stack/data/nova/instances/ea2b0016-c978-4551-a3fb-afdf0e555ade_del complete
Nov 30 11:19:51 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ea2b0016-c978-4551-a3fb-afdf0e555ade could not be found.
Nov 30 11:19:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:19:51 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[82d564f7-166a-44ee-b1ed-08e51bc53ca0]: Unexpected error while running command.
Nov 30 11:19:51 user nova-compute[75020]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 30 11:19:51 user nova-compute[75020]: Exit code: 21
Nov 30 11:19:51 user nova-compute[75020]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 30 11:19:51 user nova-compute[75020]: Stderr: '' {{(pid=86371) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 30 11:19:51 user nova-compute[75020]: Traceback (most recent call last):
Nov 30 11:19:51 user nova-compute[75020]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 30 11:19:51 user nova-compute[75020]:     ret = func(*f_args, **f_kwargs)
Nov 30 11:19:51 user nova-compute[75020]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 30 11:19:51 user nova-compute[75020]:     return func(*args, **kwargs)
Nov 30 11:19:51 user nova-compute[75020]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 30 11:19:51 user nova-compute[75020]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 30 11:19:51 user nova-compute[75020]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 30 11:19:51 user nova-compute[75020]:     return putils.execute(on_execute=on_execute,
Nov 30 11:19:51 user nova-compute[75020]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 30 11:19:51 user nova-compute[75020]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 30 11:19:51 user nova-compute[75020]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 30 11:19:51 user nova-compute[75020]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 30 11:19:51 user nova-compute[75020]: Exit code: 21
Nov 30 11:19:51 user nova-compute[75020]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 30 11:19:51 user nova-compute[75020]: Stderr: ''
Nov 30 11:19:51 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d564f7-166a-44ee-b1ed-08e51bc53ca0]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 30 11:19:51 user nova-compute[75020]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 30 11:19:51 user nova-compute[75020]: Exit code: 21
Nov 30 11:19:51 user nova-compute[75020]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 30 11:19:51 user nova-compute[75020]: Stderr: ''
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi 
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi 
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 30 11:19:51 user nova-compute[75020]: ERROR os_brick.initiator.connectors.iscsi 
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75020) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.033s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] <== disconnect_volume: return (34ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:19:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Preparing to wait for external event volume-reimaged-12d64181-c08e-46a9-be2c-8240f7e7d007 {{(pid=75020) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-47db4d91-f6c5-4789-9d87-40241305428c req-2fda05c2-b28a-4a14-8e4a-5fa32af6c5c7 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-47db4d91-f6c5-4789-9d87-40241305428c req-2fda05c2-b28a-4a14-8e4a-5fa32af6c5c7 service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-47db4d91-f6c5-4789-9d87-40241305428c req-2fda05c2-b28a-4a14-8e4a-5fa32af6c5c7 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-47db4d91-f6c5-4789-9d87-40241305428c req-2fda05c2-b28a-4a14-8e4a-5fa32af6c5c7 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:19:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-47db4d91-f6c5-4789-9d87-40241305428c req-2fda05c2-b28a-4a14-8e4a-5fa32af6c5c7 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] No event matching network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 in dict_keys([('volume-reimaged', '12d64181-c08e-46a9-be2c-8240f7e7d007')]) {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 30 11:19:52 user nova-compute[75020]: WARNING nova.compute.manager [req-47db4d91-f6c5-4789-9d87-40241305428c req-2fda05c2-b28a-4a14-8e4a-5fa32af6c5c7 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received unexpected event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 for instance with vm_state active and task_state rebuilding.
Nov 30 11:19:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:19:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:19:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updating instance_info_cache with network_info: [{"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:20:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:20:10 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:20:10 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9112MB free_disk=25.221256256103516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance ea2b0016-c978-4551-a3fb-afdf0e555ade actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-43584956-a99d-4f9a-8416-a491d91d5c4c req-a2ebf979-a066-4408-b57f-7965520379e3 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event volume-reimaged-12d64181-c08e-46a9-be2c-8240f7e7d007 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-43584956-a99d-4f9a-8416-a491d91d5c4c req-a2ebf979-a066-4408-b57f-7965520379e3 service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-43584956-a99d-4f9a-8416-a491d91d5c4c req-a2ebf979-a066-4408-b57f-7965520379e3 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-43584956-a99d-4f9a-8416-a491d91d5c4c req-a2ebf979-a066-4408-b57f-7965520379e3 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-43584956-a99d-4f9a-8416-a491d91d5c4c req-a2ebf979-a066-4408-b57f-7965520379e3 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Processing event volume-reimaged-12d64181-c08e-46a9-be2c-8240f7e7d007 {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:20:10 user nova-compute[75020]: INFO nova.virt.block_device [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Booting with volume 12d64181-c08e-46a9-be2c-8240f7e7d007 at /dev/vda
Nov 30 11:20:10 user nova-compute[75020]: DEBUG os_brick.utils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947d294-9edc-44e8-a49d-cdf69c8133a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb05896f-a858-4c61-b7a7-57323a9967af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[12652906-95db-4c4a-9323-68ad2f059321]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee02d723-c938-4e78-97be-85bf3586819a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:20:10 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:20:10 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb16d95-8ee8-4f2b-b16a-b8428ffe990f]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG os_brick.utils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:20:10 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updating existing volume attachment record: d6f84059-e25b-4851-810e-1864dde23c08 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:20:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:20:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:20:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Creating image(s)
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Did not create local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Ensure instance console log exists: /opt/stack/data/nova/instances/ea2b0016-c978-4551-a3fb-afdf0e555ade/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Start _get_guest_xml network_info=[{"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'd6f84059-e25b-4851-810e-1864dde23c08', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea2b0016-c978-4551-a3fb-afdf0e555ade', 'attached_at': '', 'detached_at': '', 'volume_id': '12d64181-c08e-46a9-be2c-8240f7e7d007', 'serial': '12d64181-c08e-46a9-be2c-8240f7e7d007'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:20:19 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 11:20:19 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:20:19 user nova-compute[75020]: DEBUG nova.objects.instance [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea2b0016-c978-4551-a3fb-afdf0e555ade {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:20:20 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:20:20 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:20:20 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6d1b62-5663-4e73-a293-ed11b677186c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:20:20 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4838facd-2187-4c70-a06d-12750a3a0f57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007] added
Nov 30 11:20:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e077bdc5-8dde-4f6c-b666-2446f5d4e2df]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99b5c3-2cff-473b-88fe-1b7d9d6701f2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSPLgXtA {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSPLgXtA" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fff18d0-10d5-4702-83d6-2928ef059d8f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSPLgXtA'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[623fcc99-02d4-4341-9401-850cad0840a3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1721221f-76ef-42d4-a615-5552492538be]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:20:20 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:20:20 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:20:20 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:20:20 user nova-compute[75020]: : NotImplementedError
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea735ada-e54f-4bca-97fc-27e8435a2de5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260]
Nov 30 11:20:20 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260] successful.
Nov 30 11:20:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f3355-67b6-4eea-b195-396acb482c10]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3a6455-6a1d-42da-b1f4-51cced383d7b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:20:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:20:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5999633d-5085-40fa-9ae3-a307f6c71d44]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:20:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26532333132386434', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532333132386434', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T11:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1791572744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1514584792',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXPjfkBRJpSIcBRhTukbhPBs+vNX8ctFYJkFsQVOyShGpNKWXVeAlmyBWuXkKceEULoYUNEjDYbVX7e4GK2ScN8E64laeCq9Tscp+sAsYHJ5fAGynYRlC67gm3mbzoow==',key_name='tempest-keypair-300189641',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b71837281e6a4d4f805d5f166a1bf5dd',ramdisk_id='',reservation_id='r-024yr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-182363408',owner_user_name='tempest-ServerActionsV293TestJSON-182363408-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f61351b3f1d41418b0bfdde96f6f006',uuid=ea2b0016-c978-4551-a3fb-afdf0e555ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converting VIF {"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:20:21 user nova-compute[75020]:   <uuid>ea2b0016-c978-4551-a3fb-afdf0e555ade</uuid>
Nov 30 11:20:21 user nova-compute[75020]:   <name>instance-0000002d</name>
Nov 30 11:20:21 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:20:21 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:20:21 user nova-compute[75020]:   <metadata>
Nov 30 11:20:21 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:20:21 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:20:21 user nova-compute[75020]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1791572744</nova:name>
Nov 30 11:20:21 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:20:19</nova:creationTime>
Nov 30 11:20:21 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:20:21 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:20:21 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:20:21 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:20:21 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:20:21 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:20:21 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:20:21 user nova-compute[75020]:       <nova:owner>
Nov 30 11:20:21 user nova-compute[75020]:         <nova:user uuid="0f61351b3f1d41418b0bfdde96f6f006">tempest-ServerActionsV293TestJSON-182363408-project-member</nova:user>
Nov 30 11:20:21 user nova-compute[75020]:         <nova:project uuid="b71837281e6a4d4f805d5f166a1bf5dd">tempest-ServerActionsV293TestJSON-182363408</nova:project>
Nov 30 11:20:21 user nova-compute[75020]:       </nova:owner>
Nov 30 11:20:21 user nova-compute[75020]:       <nova:ports>
Nov 30 11:20:21 user nova-compute[75020]:         <nova:port uuid="9bc84dc6-9697-416e-b83e-52c492bf96f0">
Nov 30 11:20:21 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 11:20:21 user nova-compute[75020]:         </nova:port>
Nov 30 11:20:21 user nova-compute[75020]:       </nova:ports>
Nov 30 11:20:21 user nova-compute[75020]:     </nova:instance>
Nov 30 11:20:21 user nova-compute[75020]:   </metadata>
Nov 30 11:20:21 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:20:21 user nova-compute[75020]:     <system>
Nov 30 11:20:21 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:20:21 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:20:21 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:20:21 user nova-compute[75020]:       <entry name="serial">ea2b0016-c978-4551-a3fb-afdf0e555ade</entry>
Nov 30 11:20:21 user nova-compute[75020]:       <entry name="uuid">ea2b0016-c978-4551-a3fb-afdf0e555ade</entry>
Nov 30 11:20:21 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:20:21 user nova-compute[75020]:     </system>
Nov 30 11:20:21 user nova-compute[75020]:   </sysinfo>
Nov 30 11:20:21 user nova-compute[75020]:   <os>
Nov 30 11:20:21 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:20:21 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:20:21 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:20:21 user nova-compute[75020]:   </os>
Nov 30 11:20:21 user nova-compute[75020]:   <features>
Nov 30 11:20:21 user nova-compute[75020]:     <acpi/>
Nov 30 11:20:21 user nova-compute[75020]:     <apic/>
Nov 30 11:20:21 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:20:21 user nova-compute[75020]:   </features>
Nov 30 11:20:21 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:20:21 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:20:21 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:20:21 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:20:21 user nova-compute[75020]:   </clock>
Nov 30 11:20:21 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:20:21 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:20:21 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:20:21 user nova-compute[75020]:   </cpu>
Nov 30 11:20:21 user nova-compute[75020]:   <devices>
Nov 30 11:20:21 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:20:21 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:20:21 user nova-compute[75020]:       <source dev="/dev/sdb"/>
Nov 30 11:20:21 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:20:21 user nova-compute[75020]:       <serial>12d64181-c08e-46a9-be2c-8240f7e7d007</serial>
Nov 30 11:20:21 user nova-compute[75020]:     </disk>
Nov 30 11:20:21 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:20:21 user nova-compute[75020]:       <mac address="fa:16:3e:af:4a:f1"/>
Nov 30 11:20:21 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:20:21 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:20:21 user nova-compute[75020]:       <target dev="tap9bc84dc6-96"/>
Nov 30 11:20:21 user nova-compute[75020]:     </interface>
Nov 30 11:20:21 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:20:21 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/ea2b0016-c978-4551-a3fb-afdf0e555ade/console.log" append="off"/>
Nov 30 11:20:21 user nova-compute[75020]:     </serial>
Nov 30 11:20:21 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:20:21 user nova-compute[75020]:     <video>
Nov 30 11:20:21 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:20:21 user nova-compute[75020]:     </video>
Nov 30 11:20:21 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:20:21 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:20:21 user nova-compute[75020]:     </rng>
Nov 30 11:20:21 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:20:21 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:20:21 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:20:21 user nova-compute[75020]:     </memballoon>
Nov 30 11:20:21 user nova-compute[75020]:   </devices>
Nov 30 11:20:21 user nova-compute[75020]: </domain>
Nov 30 11:20:21 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T11:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1791572744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1514584792',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXPjfkBRJpSIcBRhTukbhPBs+vNX8ctFYJkFsQVOyShGpNKWXVeAlmyBWuXkKceEULoYUNEjDYbVX7e4GK2ScN8E64laeCq9Tscp+sAsYHJ5fAGynYRlC67gm3mbzoow==',key_name='tempest-keypair-300189641',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b71837281e6a4d4f805d5f166a1bf5dd',ramdisk_id='',reservation_id='r-024yr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-182363408',owner_user_name='tempest-ServerActionsV293TestJSON-182363408-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f61351b3f1d41418b0bfdde96f6f006',uuid=ea2b0016-c978-4551-a3fb-afdf0e555ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converting VIF {"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG os_vif [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd39ca291-3d9b-5d9d-9c37-002e2827d262', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bc84dc6-96, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bc84dc6-96, col_values=(('qos', UUID('9d71bc3a-3bbb-4b29-959a-6ea4393b774a')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bc84dc6-96, col_values=(('external_ids', {'iface-id': '9bc84dc6-9697-416e-b83e-52c492bf96f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:4a:f1', 'vm-uuid': 'ea2b0016-c978-4551-a3fb-afdf0e555ade'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:21 user nova-compute[75020]: INFO os_vif [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96')
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:20:21 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] No VIF found with MAC fa:16:3e:af:4a:f1, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:20:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-fbcff7e1-a7d5-4272-81eb-858c2c88d1f6 req-3486725b-cd4b-4d95-89b4-b082d4282540 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:20:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fbcff7e1-a7d5-4272-81eb-858c2c88d1f6 req-3486725b-cd4b-4d95-89b4-b082d4282540 service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:20:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fbcff7e1-a7d5-4272-81eb-858c2c88d1f6 req-3486725b-cd4b-4d95-89b4-b082d4282540 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:20:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fbcff7e1-a7d5-4272-81eb-858c2c88d1f6 req-3486725b-cd4b-4d95-89b4-b082d4282540 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:20:22 user nova-compute[75020]: DEBUG nova.compute.manager [req-fbcff7e1-a7d5-4272-81eb-858c2c88d1f6 req-3486725b-cd4b-4d95-89b4-b082d4282540 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] No waiting events found dispatching network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:20:22 user nova-compute[75020]: WARNING nova.compute.manager [req-fbcff7e1-a7d5-4272-81eb-858c2c88d1f6 req-3486725b-cd4b-4d95-89b4-b082d4282540 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received unexpected event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 11:20:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.compute.manager [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:20:24 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance spawned successfully.
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-7b3470e2-27a0-4abb-b914-13a003dd986d req-4cda3294-d750-4615-8a3a-d7b6f9847756 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7b3470e2-27a0-4abb-b914-13a003dd986d req-4cda3294-d750-4615-8a3a-d7b6f9847756 service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7b3470e2-27a0-4abb-b914-13a003dd986d req-4cda3294-d750-4615-8a3a-d7b6f9847756 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7b3470e2-27a0-4abb-b914-13a003dd986d req-4cda3294-d750-4615-8a3a-d7b6f9847756 service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:20:24 user nova-compute[75020]: DEBUG nova.compute.manager [req-7b3470e2-27a0-4abb-b914-13a003dd986d req-4cda3294-d750-4615-8a3a-d7b6f9847756 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] No waiting events found dispatching network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:20:24 user nova-compute[75020]: WARNING nova.compute.manager [req-7b3470e2-27a0-4abb-b914-13a003dd986d req-4cda3294-d750-4615-8a3a-d7b6f9847756 service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received unexpected event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 11:20:25 user nova-compute[75020]: DEBUG nova.compute.manager [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:20:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:20:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:20:25 user nova-compute[75020]: DEBUG nova.objects.instance [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75020) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 11:20:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-43584956-a99d-4f9a-8416-a491d91d5c4c tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:20:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:20:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:20:59 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:06 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:21:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:21:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:21:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid ea2b0016-c978-4551-a3fb-afdf0e555ade {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updating instance_info_cache with network_info: [{"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-ea2b0016-c978-4551-a3fb-afdf0e555ade" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:21:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:11 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:21:12 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:21:12 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=25.219497680664062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance ea2b0016-c978-4551-a3fb-afdf0e555ade actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:21:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:21:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:21:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:21:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:21:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:21:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:21:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:21:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:21:42 user nova-compute[75020]: INFO nova.compute.manager [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Terminating instance
Nov 30 11:21:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-4a8eca97-e877-441f-b348-152fb56962e6 req-2e20c3b9-e5e2-45bd-985a-8757edfe928b service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-unplugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4a8eca97-e877-441f-b348-152fb56962e6 req-2e20c3b9-e5e2-45bd-985a-8757edfe928b service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4a8eca97-e877-441f-b348-152fb56962e6 req-2e20c3b9-e5e2-45bd-985a-8757edfe928b service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4a8eca97-e877-441f-b348-152fb56962e6 req-2e20c3b9-e5e2-45bd-985a-8757edfe928b service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-4a8eca97-e877-441f-b348-152fb56962e6 req-2e20c3b9-e5e2-45bd-985a-8757edfe928b service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] No waiting events found dispatching network-vif-unplugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG nova.compute.manager [req-4a8eca97-e877-441f-b348-152fb56962e6 req-2e20c3b9-e5e2-45bd-985a-8757edfe928b service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-unplugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Instance destroyed successfully.
Nov 30 11:21:43 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lazy-loading 'resources' on Instance uuid ea2b0016-c978-4551-a3fb-afdf0e555ade {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T11:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1791572744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1514584792',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXPjfkBRJpSIcBRhTukbhPBs+vNX8ctFYJkFsQVOyShGpNKWXVeAlmyBWuXkKceEULoYUNEjDYbVX7e4GK2ScN8E64laeCq9Tscp+sAsYHJ5fAGynYRlC67gm3mbzoow==',key_name='tempest-keypair-300189641',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:20:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b71837281e6a4d4f805d5f166a1bf5dd',ramdisk_id='',reservation_id='r-024yr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-182363408',owner_user_name='tempest-ServerActionsV293TestJSON-182363408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f61351b3f1d41418b0bfdde96f6f006',uuid=ea2b0016-c978-4551-a3fb-afdf0e555ade,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converting VIF {"id": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "address": "fa:16:3e:af:4a:f1", "network": {"id": "f79ee9e0-beab-4df5-96b7-9b678aa39ccb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1777654024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b71837281e6a4d4f805d5f166a1bf5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc84dc6-96", "ovs_interfaceid": "9bc84dc6-9697-416e-b83e-52c492bf96f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_vif [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bc84dc6-96, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d71bc3a-3bbb-4b29-959a-6ea4393b774a) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:43 user nova-compute[75020]: INFO os_vif [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:4a:f1,bridge_name='br-int',has_traffic_filtering=True,id=9bc84dc6-9697-416e-b83e-52c492bf96f0,network=Network(f79ee9e0-beab-4df5-96b7-9b678aa39ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc84dc6-96')
Nov 30 11:21:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSPLgXtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:21:43 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bde4b3-ef13-446d-a7ba-ac4787905897]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:21:43 user nova-compute[75020]: No targets found.
Nov 30 11:21:43 user nova-compute[75020]: iSNS:
Nov 30 11:21:43 user nova-compute[75020]: No targets found.
Nov 30 11:21:43 user nova-compute[75020]: STATIC:
Nov 30 11:21:43 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007
Nov 30 11:21:43 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:21:43 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:21:43 user nova-compute[75020]: FIRMWARE:
Nov 30 11:21:43 user nova-compute[75020]: No targets found.
Nov 30 11:21:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:21:43 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:21:43 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[51932891-afb3-49f4-96f1-33359affc094]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cf3bb3-6f8a-4452-8b63-7ff44f4bbca3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:21:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 (non-flash)
Nov 30 11:21:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad885fd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[70901fff-0764-4e1e-88d5-e64051272139]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21bb649-c70b-4991-bd76-f6f38a4aa5e8]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe440a3-d2f0-43d8-aa16-6d74f14ab42e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d668dd-5c5c-4f09-9287-6eb68494e281]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c992b241-c005-4f1d-bbb5-679f8712f37e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6ff54b-8e2b-45f9-a928-22139b779522]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260]
Nov 30 11:21:43 user nova-compute[75020]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007, portal: 172.16.0.220,3260] successful.
Nov 30 11:21:43 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d64181-c08e-46a9-be2c-8240f7e7d007 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e786ec0-915a-4e98-a278-68f3f872343f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] <== disconnect_volume: return (296ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:21:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Deleting instance files /opt/stack/data/nova/instances/ea2b0016-c978-4551-a3fb-afdf0e555ade_del
Nov 30 11:21:43 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Deletion of /opt/stack/data/nova/instances/ea2b0016-c978-4551-a3fb-afdf0e555ade_del complete
Nov 30 11:21:43 user nova-compute[75020]: INFO nova.compute.manager [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 30 11:21:43 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:21:43 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:21:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:44 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:21:44 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Took 1.03 seconds to deallocate network for instance.
Nov 30 11:21:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-4affcb45-70e1-4a1e-a7c0-3db49fb10489 req-739ea40d-c8f4-4560-b04d-a9f3c96b46ad service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-deleted-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:21:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-6ee6c90c-8780-4c5d-aebf-7be34d02c958 req-423ff314-3559-4380-aed6-65926a35aa2c service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:21:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6ee6c90c-8780-4c5d-aebf-7be34d02c958 req-423ff314-3559-4380-aed6-65926a35aa2c service nova] Acquiring lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:21:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6ee6c90c-8780-4c5d-aebf-7be34d02c958 req-423ff314-3559-4380-aed6-65926a35aa2c service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:21:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6ee6c90c-8780-4c5d-aebf-7be34d02c958 req-423ff314-3559-4380-aed6-65926a35aa2c service nova] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:21:44 user nova-compute[75020]: DEBUG nova.compute.manager [req-6ee6c90c-8780-4c5d-aebf-7be34d02c958 req-423ff314-3559-4380-aed6-65926a35aa2c service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] No waiting events found dispatching network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:21:44 user nova-compute[75020]: WARNING nova.compute.manager [req-6ee6c90c-8780-4c5d-aebf-7be34d02c958 req-423ff314-3559-4380-aed6-65926a35aa2c service nova] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Received unexpected event network-vif-plugged-9bc84dc6-9697-416e-b83e-52c492bf96f0 for instance with vm_state active and task_state deleting.
Nov 30 11:21:45 user nova-compute[75020]: INFO nova.compute.manager [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Took 0.81 seconds to detach 1 volumes for instance.
Nov 30 11:21:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] [instance: ea2b0016-c978-4551-a3fb-afdf0e555ade] Deleting volume: 12d64181-c08e-46a9-be2c-8240f7e7d007 {{(pid=75020) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 11:21:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:21:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:21:45 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:21:45 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:21:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:21:45 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Deleted allocations for instance ea2b0016-c978-4551-a3fb-afdf0e555ade
Nov 30 11:21:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cc0e2a56-4524-4d46-a482-77ff0b22c5fc tempest-ServerActionsV293TestJSON-182363408 tempest-ServerActionsV293TestJSON-182363408-project-member] Lock "ea2b0016-c978-4551-a3fb-afdf0e555ade" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.360s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:21:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:21:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:21:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:21:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:21:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:21:59 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:22:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:22:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:22:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:22:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:22:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:22:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:22:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:22:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:22:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9199MB free_disk=25.218677520751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:22:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:22:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:22:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:22:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:22:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:22:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:22:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:22:47 user nova-compute[75020]: INFO nova.compute.claims [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Claim successful on node user
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:22:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.policy [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80403fda7f794fc79a9b7fdfb3297c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb663b4ea574c5aaab1acc6f9d7c3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:22:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Creating image(s)
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "/opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "/opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.206s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk 1073741824" returned: 0 in 0.064s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Successfully created port: d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Cannot resize image /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Ensure instance console log exists: /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Successfully updated port: d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquired lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-7f32740e-c1d2-497c-a098-18a27d6ce6b2 req-3d49be39-349e-47cf-989d-d722b7e2d36b service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received event network-changed-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-7f32740e-c1d2-497c-a098-18a27d6ce6b2 req-3d49be39-349e-47cf-989d-d722b7e2d36b service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Refreshing instance network info cache due to event network-changed-d78cf676-82a6-40aa-b23f-f222a4d6591a. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:22:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7f32740e-c1d2-497c-a098-18a27d6ce6b2 req-3d49be39-349e-47cf-989d-d722b7e2d36b service nova] Acquiring lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Releasing lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Instance network_info: |[{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7f32740e-c1d2-497c-a098-18a27d6ce6b2 req-3d49be39-349e-47cf-989d-d722b7e2d36b service nova] Acquired lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-7f32740e-c1d2-497c-a098-18a27d6ce6b2 req-3d49be39-349e-47cf-989d-d722b7e2d36b service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Refreshing network info cache for port d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Start _get_guest_xml network_info=[{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:22:49 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:22:49 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1321673704',display_name='tempest-AttachVolumeNegativeTest-server-1321673704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1321673704',id=46,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6We1JPfpnSyo84oq/gIogDWcUbW7lzB3GXG30r6G8a6fzbLPYBOQv19b8VhWlJtjp10CMkiayVRetk92+yG82ezDZSeJXYFMeQgcRz56n2Gep1i8Pe3Gz9iNvqtoqg+A==',key_name='tempest-keypair-1723291603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-cbsvz3uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:22:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=5d623399-705b-4ebf-8bd1-13f6e2dbbc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=d78cf676-82a6-40aa-b23f-f222a4d6591a,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78cf676-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.objects.instance [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:22:49 user nova-compute[75020]:   <uuid>5d623399-705b-4ebf-8bd1-13f6e2dbbc97</uuid>
Nov 30 11:22:49 user nova-compute[75020]:   <name>instance-0000002e</name>
Nov 30 11:22:49 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:22:49 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:22:49 user nova-compute[75020]:   <metadata>
Nov 30 11:22:49 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:22:49 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:22:49 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1321673704</nova:name>
Nov 30 11:22:49 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:22:49</nova:creationTime>
Nov 30 11:22:49 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:22:49 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:22:49 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:22:49 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:22:49 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:22:49 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:22:49 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:22:49 user nova-compute[75020]:       <nova:owner>
Nov 30 11:22:49 user nova-compute[75020]:         <nova:user uuid="80403fda7f794fc79a9b7fdfb3297c72">tempest-AttachVolumeNegativeTest-560525472-project-member</nova:user>
Nov 30 11:22:49 user nova-compute[75020]:         <nova:project uuid="5fb663b4ea574c5aaab1acc6f9d7c3a2">tempest-AttachVolumeNegativeTest-560525472</nova:project>
Nov 30 11:22:49 user nova-compute[75020]:       </nova:owner>
Nov 30 11:22:49 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:22:49 user nova-compute[75020]:       <nova:ports>
Nov 30 11:22:49 user nova-compute[75020]:         <nova:port uuid="d78cf676-82a6-40aa-b23f-f222a4d6591a">
Nov 30 11:22:49 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 11:22:49 user nova-compute[75020]:         </nova:port>
Nov 30 11:22:49 user nova-compute[75020]:       </nova:ports>
Nov 30 11:22:49 user nova-compute[75020]:     </nova:instance>
Nov 30 11:22:49 user nova-compute[75020]:   </metadata>
Nov 30 11:22:49 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:22:49 user nova-compute[75020]:     <system>
Nov 30 11:22:49 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:22:49 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:22:49 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:22:49 user nova-compute[75020]:       <entry name="serial">5d623399-705b-4ebf-8bd1-13f6e2dbbc97</entry>
Nov 30 11:22:49 user nova-compute[75020]:       <entry name="uuid">5d623399-705b-4ebf-8bd1-13f6e2dbbc97</entry>
Nov 30 11:22:49 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:22:49 user nova-compute[75020]:     </system>
Nov 30 11:22:49 user nova-compute[75020]:   </sysinfo>
Nov 30 11:22:49 user nova-compute[75020]:   <os>
Nov 30 11:22:49 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:22:49 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:22:49 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:22:49 user nova-compute[75020]:   </os>
Nov 30 11:22:49 user nova-compute[75020]:   <features>
Nov 30 11:22:49 user nova-compute[75020]:     <acpi/>
Nov 30 11:22:49 user nova-compute[75020]:     <apic/>
Nov 30 11:22:49 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:22:49 user nova-compute[75020]:   </features>
Nov 30 11:22:49 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:22:49 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:22:49 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:22:49 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:22:49 user nova-compute[75020]:   </clock>
Nov 30 11:22:49 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:22:49 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:22:49 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:22:49 user nova-compute[75020]:   </cpu>
Nov 30 11:22:49 user nova-compute[75020]:   <devices>
Nov 30 11:22:49 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:22:49 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:22:49 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk"/>
Nov 30 11:22:49 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:22:49 user nova-compute[75020]:     </disk>
Nov 30 11:22:49 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:22:49 user nova-compute[75020]:       <mac address="fa:16:3e:d2:14:7c"/>
Nov 30 11:22:49 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:22:49 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:22:49 user nova-compute[75020]:       <target dev="tapd78cf676-82"/>
Nov 30 11:22:49 user nova-compute[75020]:     </interface>
Nov 30 11:22:49 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:22:49 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/console.log" append="off"/>
Nov 30 11:22:49 user nova-compute[75020]:     </serial>
Nov 30 11:22:49 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:22:49 user nova-compute[75020]:     <video>
Nov 30 11:22:49 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:22:49 user nova-compute[75020]:     </video>
Nov 30 11:22:49 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:22:49 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:22:49 user nova-compute[75020]:     </rng>
Nov 30 11:22:49 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:22:49 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:22:49 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:22:49 user nova-compute[75020]:     </memballoon>
Nov 30 11:22:49 user nova-compute[75020]:   </devices>
Nov 30 11:22:49 user nova-compute[75020]: </domain>
Nov 30 11:22:49 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1321673704',display_name='tempest-AttachVolumeNegativeTest-server-1321673704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1321673704',id=46,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6We1JPfpnSyo84oq/gIogDWcUbW7lzB3GXG30r6G8a6fzbLPYBOQv19b8VhWlJtjp10CMkiayVRetk92+yG82ezDZSeJXYFMeQgcRz56n2Gep1i8Pe3Gz9iNvqtoqg+A==',key_name='tempest-keypair-1723291603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-cbsvz3uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:22:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=5d623399-705b-4ebf-8bd1-13f6e2dbbc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=d78cf676-82a6-40aa-b23f-f222a4d6591a,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78cf676-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG os_vif [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=d78cf676-82a6-40aa-b23f-f222a4d6591a,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78cf676-82') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '403458fb-61a4-5750-a6f5-07fdb57ba0ac', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd78cf676-82, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd78cf676-82, col_values=(('qos', UUID('0c6bbfe7-a1ab-45e7-892e-76abdd05058f')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd78cf676-82, col_values=(('external_ids', {'iface-id': 'd78cf676-82a6-40aa-b23f-f222a4d6591a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:14:7c', 'vm-uuid': '5d623399-705b-4ebf-8bd1-13f6e2dbbc97'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:49 user nova-compute[75020]: INFO os_vif [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=d78cf676-82a6-40aa-b23f-f222a4d6591a,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78cf676-82')
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No VIF found with MAC fa:16:3e:d2:14:7c, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-7f32740e-c1d2-497c-a098-18a27d6ce6b2 req-3d49be39-349e-47cf-989d-d722b7e2d36b service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updated VIF entry in instance network info cache for port d78cf676-82a6-40aa-b23f-f222a4d6591a. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG nova.network.neutron [req-7f32740e-c1d2-497c-a098-18a27d6ce6b2 req-3d49be39-349e-47cf-989d-d722b7e2d36b service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:22:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-7f32740e-c1d2-497c-a098-18a27d6ce6b2 req-3d49be39-349e-47cf-989d-d722b7e2d36b service nova] Releasing lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:22:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-e5c5db61-f5a3-4445-950a-18689876c220 req-d0190762-8788-45b3-8683-648c19f53720 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received event network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:22:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e5c5db61-f5a3-4445-950a-18689876c220 req-d0190762-8788-45b3-8683-648c19f53720 service nova] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e5c5db61-f5a3-4445-950a-18689876c220 req-d0190762-8788-45b3-8683-648c19f53720 service nova] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e5c5db61-f5a3-4445-950a-18689876c220 req-d0190762-8788-45b3-8683-648c19f53720 service nova] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-e5c5db61-f5a3-4445-950a-18689876c220 req-d0190762-8788-45b3-8683-648c19f53720 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] No waiting events found dispatching network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:22:51 user nova-compute[75020]: WARNING nova.compute.manager [req-e5c5db61-f5a3-4445-950a-18689876c220 req-d0190762-8788-45b3-8683-648c19f53720 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received unexpected event network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a for instance with vm_state building and task_state spawning.
Nov 30 11:22:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:22:52 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Instance spawned successfully.
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:22:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:22:53 user nova-compute[75020]: INFO nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 30 11:22:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:22:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-468dd9ce-5784-4ef4-8ab7-b5f5f22605e7 req-b88d779d-5c90-44d7-8cd2-c4beeabba23d service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received event network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:22:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-468dd9ce-5784-4ef4-8ab7-b5f5f22605e7 req-b88d779d-5c90-44d7-8cd2-c4beeabba23d service nova] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:22:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-468dd9ce-5784-4ef4-8ab7-b5f5f22605e7 req-b88d779d-5c90-44d7-8cd2-c4beeabba23d service nova] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:22:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-468dd9ce-5784-4ef4-8ab7-b5f5f22605e7 req-b88d779d-5c90-44d7-8cd2-c4beeabba23d service nova] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-468dd9ce-5784-4ef4-8ab7-b5f5f22605e7 req-b88d779d-5c90-44d7-8cd2-c4beeabba23d service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] No waiting events found dispatching network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:22:53 user nova-compute[75020]: WARNING nova.compute.manager [req-468dd9ce-5784-4ef4-8ab7-b5f5f22605e7 req-b88d779d-5c90-44d7-8cd2-c4beeabba23d service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received unexpected event network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a for instance with vm_state building and task_state spawning.
Nov 30 11:22:53 user nova-compute[75020]: INFO nova.compute.manager [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Took 6.08 seconds to build instance.
Nov 30 11:22:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31b489c8-72fa-4fde-961f-79f6ffea6f7a tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.202s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:22:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:22:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:00 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:23:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:23:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:23:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:23:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:23:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:23:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:23:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.18207550048828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:23:13 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:23:14 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:23:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:23:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:23:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:23:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:23:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Verify base images {{(pid=75020) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Image id a0e347bf-fa3a-4008-b934-b96aa4570396 yields fingerprint c1d821214d135e408b9cb8db8af47c5218453814 {{(pid=75020) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] image a0e347bf-fa3a-4008-b934-b96aa4570396 at (/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814): checking
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] image a0e347bf-fa3a-4008-b934-b96aa4570396 at (/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814): image is in use {{(pid=75020) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75020) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 is a valid instance name {{(pid=75020) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 has a disk file {{(pid=75020) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 is backed by c1d821214d135e408b9cb8db8af47c5218453814 {{(pid=75020) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 30 11:23:32 user nova-compute[75020]: WARNING nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Unknown base file: /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1
Nov 30 11:23:32 user nova-compute[75020]: WARNING nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Unknown base file: /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0
Nov 30 11:23:32 user nova-compute[75020]: WARNING nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Unknown base file: /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf
Nov 30 11:23:32 user nova-compute[75020]: WARNING nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Unknown base file: /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0
Nov 30 11:23:32 user nova-compute[75020]: WARNING nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Unknown base file: /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d
Nov 30 11:23:32 user nova-compute[75020]: WARNING nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Unknown base file: /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0
Nov 30 11:23:32 user nova-compute[75020]: WARNING nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Unknown base file: /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Active base files: /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Removable base files: /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1 /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0 /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0 /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0 /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/af2ec5b5de3cfbe64c63db2c1f737b160c0215c1
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7fe6e8a5ef4c971fcd368044c0611af83e361db0
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/385cab2323ef191b8e030592a61ce2df60c0a2cf
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f1c659afb5f3772c43bd163bdac91c7671453bf0
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b49a00f285e2e14c48cf3279aa19732bce40945d
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7a8e10dd1fee0838bb0d2afd49c8ef90db32deb0
Nov 30 11:23:32 user nova-compute[75020]: INFO nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1e6da450debb2f3092d39a6d55d7e477fcf1763b
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Verification complete {{(pid=75020) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Verify swap images {{(pid=75020) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 30 11:23:32 user nova-compute[75020]: DEBUG nova.virt.libvirt.imagecache [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Verify ephemeral images {{(pid=75020) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 30 11:23:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:23:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:23:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:23:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:23:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:23:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:23:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:23:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:23:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:23:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:23:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:23:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:01 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:05 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:06 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:24:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:24:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:24:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:24:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=25.179977416992188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:24:13 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:24:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:24:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:24:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:24:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:24:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:24:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:24:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:24:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:24:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:24:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:24:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:24:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-283d6652-a30a-4cbb-b83e-72cab453a33e req-fe0cd90d-b9b2-4614-acad-00968842e5f1 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received event network-changed-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-283d6652-a30a-4cbb-b83e-72cab453a33e req-fe0cd90d-b9b2-4614-acad-00968842e5f1 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Refreshing instance network info cache due to event network-changed-d78cf676-82a6-40aa-b23f-f222a4d6591a. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-283d6652-a30a-4cbb-b83e-72cab453a33e req-fe0cd90d-b9b2-4614-acad-00968842e5f1 service nova] Acquiring lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-283d6652-a30a-4cbb-b83e-72cab453a33e req-fe0cd90d-b9b2-4614-acad-00968842e5f1 service nova] Acquired lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-283d6652-a30a-4cbb-b83e-72cab453a33e req-fe0cd90d-b9b2-4614-acad-00968842e5f1 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Refreshing network info cache for port d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-283d6652-a30a-4cbb-b83e-72cab453a33e req-fe0cd90d-b9b2-4614-acad-00968842e5f1 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updated VIF entry in instance network info cache for port d78cf676-82a6-40aa-b23f-f222a4d6591a. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-283d6652-a30a-4cbb-b83e-72cab453a33e req-fe0cd90d-b9b2-4614-acad-00968842e5f1 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:24:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-283d6652-a30a-4cbb-b83e-72cab453a33e req-fe0cd90d-b9b2-4614-acad-00968842e5f1 service nova] Releasing lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:24:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:40 user nova-compute[75020]: DEBUG nova.objects.instance [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:24:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:41 user nova-compute[75020]: INFO nova.compute.manager [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Attaching volume cf1674b8-4c83-4dbc-b3f7-964743e235ef to /dev/vdb
Nov 30 11:24:41 user nova-compute[75020]: DEBUG os_brick.utils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a9d70-3082-4067-95b9-7b26572ef737]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09e286b-2630-48e6-b068-afd34df79a20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c908847-dc24-4b2e-bab7-5f97b9312340]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[66250bce-afa6-4bdf-8390-5072927ebdc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:24:41 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:24:41 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacda8b9-27e5-4642-8605-5960b2b79c32]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG os_brick.utils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:24:41 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating existing volume attachment record: 85c01328-51ce-4463-80f7-19ee14d0c2f7 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:24:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:24:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUwkSYXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:24:49 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:24:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:24:49 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:24:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:24:49 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:24:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c705a4f-10b9-49cf-8709-af3d5b8b3b4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:24:49 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c8bb5b-4e94-4e1b-986d-a515b8bfd82f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef] added
Nov 30 11:24:49 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:24:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40a220b-82fb-41f1-9c0a-f1f80fe1f9c9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[53469db4-bc79-4eae-9b3e-791cc1bb465d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUwkSYXp {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUwkSYXp" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a98b8b-a108-48ef-b473-f4fe5a6c2eb4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUwkSYXp'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28b2a3e-0bc2-45e9-88ee-1a757d75d55e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a913b2db-c50b-4f3b-986c-a40b4fd32cdf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:24:50 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:24:50 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:24:50 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:24:50 user nova-compute[75020]: 
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ab7540-14bb-4898-98de-e0db1eb358ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef, portal: 172.16.0.220,3260]
Nov 30 11:24:50 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef, portal: 172.16.0.220,3260] successful.
Nov 30 11:24:50 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a224812-91a0-49d6-ac3b-c3c0c67c4268]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7760705e-bb04-4dcd-b276-cdc82e12c9dc]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef (non-flash)
Nov 30 11:24:50 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef (non-flash)
Nov 30 11:24:50 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeec824-6306-4bed-9095-d2f5bf44af14]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:24:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUwkSYXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23364653461303832', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364653461303832', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG nova.objects.instance [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:24:51 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:24:51 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:24:51 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:24:51 user nova-compute[75020]:   <serial>cf1674b8-4c83-4dbc-b3f7-964743e235ef</serial>
Nov 30 11:24:51 user nova-compute[75020]: </disk>
Nov 30 11:24:51 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No VIF found with MAC fa:16:3e:d2:14:7c, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-28f42c0d-5c71-4ab9-af7a-323bff609c35 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.591s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.168s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:24:54 user nova-compute[75020]: INFO nova.compute.claims [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Claim successful on node user
Nov 30 11:24:54 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:24:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:24:54 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:24:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG nova.policy [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80403fda7f794fc79a9b7fdfb3297c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb663b4ea574c5aaab1acc6f9d7c3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:24:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Creating image(s)
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "/opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "/opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "/opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk 1073741824" returned: 0 in 0.050s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Successfully created port: 03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Cannot resize image /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Ensure instance console log exists: /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:55 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Successfully updated port: 03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquired lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-1202b59f-58c4-42e2-9ff0-6518768f8544 req-b0c016a7-dc88-4988-a544-ef54d8eac279 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received event network-changed-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-1202b59f-58c4-42e2-9ff0-6518768f8544 req-b0c016a7-dc88-4988-a544-ef54d8eac279 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Refreshing instance network info cache due to event network-changed-03b01ff9-6180-4405-a448-89b353d0f1a6. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1202b59f-58c4-42e2-9ff0-6518768f8544 req-b0c016a7-dc88-4988-a544-ef54d8eac279 service nova] Acquiring lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.neutron [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Updating instance_info_cache with network_info: [{"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Releasing lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Instance network_info: |[{"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1202b59f-58c4-42e2-9ff0-6518768f8544 req-b0c016a7-dc88-4988-a544-ef54d8eac279 service nova] Acquired lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.neutron [req-1202b59f-58c4-42e2-9ff0-6518768f8544 req-b0c016a7-dc88-4988-a544-ef54d8eac279 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Refreshing network info cache for port 03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Start _get_guest_xml network_info=[{"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:24:56 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:24:56 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-447735209',display_name='tempest-AttachVolumeNegativeTest-server-447735209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-447735209',id=47,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6SKb9boDe/ni3P8zzyMupBeLK7ZfdiNxC1Hwqo82bBSYJ0UJeBfs0mptlrBhWFIzF0zn5JkdDZtfZfGTlt6E/CG1aVMr7o4XaNE0v4helUES+cG+5GOaej5qf0UxREFQ==',key_name='tempest-keypair-1237866748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-fapqu302',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=8512ce5f-1d19-4054-a837-4dbcebd5b7e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:a6:b9,bridge_name='br-int',has_traffic_filtering=True,id=03b01ff9-6180-4405-a448-89b353d0f1a6,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b01ff9-61') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'pci_devices' on Instance uuid 8512ce5f-1d19-4054-a837-4dbcebd5b7e0 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:24:56 user nova-compute[75020]:   <uuid>8512ce5f-1d19-4054-a837-4dbcebd5b7e0</uuid>
Nov 30 11:24:56 user nova-compute[75020]:   <name>instance-0000002f</name>
Nov 30 11:24:56 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:24:56 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:24:56 user nova-compute[75020]:   <metadata>
Nov 30 11:24:56 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:24:56 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:24:56 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeNegativeTest-server-447735209</nova:name>
Nov 30 11:24:56 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:24:56</nova:creationTime>
Nov 30 11:24:56 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:24:56 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:24:56 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:24:56 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:24:56 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:24:56 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:24:56 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:24:56 user nova-compute[75020]:       <nova:owner>
Nov 30 11:24:56 user nova-compute[75020]:         <nova:user uuid="80403fda7f794fc79a9b7fdfb3297c72">tempest-AttachVolumeNegativeTest-560525472-project-member</nova:user>
Nov 30 11:24:56 user nova-compute[75020]:         <nova:project uuid="5fb663b4ea574c5aaab1acc6f9d7c3a2">tempest-AttachVolumeNegativeTest-560525472</nova:project>
Nov 30 11:24:56 user nova-compute[75020]:       </nova:owner>
Nov 30 11:24:56 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:24:56 user nova-compute[75020]:       <nova:ports>
Nov 30 11:24:56 user nova-compute[75020]:         <nova:port uuid="03b01ff9-6180-4405-a448-89b353d0f1a6">
Nov 30 11:24:56 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 11:24:56 user nova-compute[75020]:         </nova:port>
Nov 30 11:24:56 user nova-compute[75020]:       </nova:ports>
Nov 30 11:24:56 user nova-compute[75020]:     </nova:instance>
Nov 30 11:24:56 user nova-compute[75020]:   </metadata>
Nov 30 11:24:56 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:24:56 user nova-compute[75020]:     <system>
Nov 30 11:24:56 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:24:56 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:24:56 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:24:56 user nova-compute[75020]:       <entry name="serial">8512ce5f-1d19-4054-a837-4dbcebd5b7e0</entry>
Nov 30 11:24:56 user nova-compute[75020]:       <entry name="uuid">8512ce5f-1d19-4054-a837-4dbcebd5b7e0</entry>
Nov 30 11:24:56 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:24:56 user nova-compute[75020]:     </system>
Nov 30 11:24:56 user nova-compute[75020]:   </sysinfo>
Nov 30 11:24:56 user nova-compute[75020]:   <os>
Nov 30 11:24:56 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:24:56 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:24:56 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:24:56 user nova-compute[75020]:   </os>
Nov 30 11:24:56 user nova-compute[75020]:   <features>
Nov 30 11:24:56 user nova-compute[75020]:     <acpi/>
Nov 30 11:24:56 user nova-compute[75020]:     <apic/>
Nov 30 11:24:56 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:24:56 user nova-compute[75020]:   </features>
Nov 30 11:24:56 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:24:56 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:24:56 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:24:56 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:24:56 user nova-compute[75020]:   </clock>
Nov 30 11:24:56 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:24:56 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:24:56 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:24:56 user nova-compute[75020]:   </cpu>
Nov 30 11:24:56 user nova-compute[75020]:   <devices>
Nov 30 11:24:56 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:24:56 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:24:56 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk"/>
Nov 30 11:24:56 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:24:56 user nova-compute[75020]:     </disk>
Nov 30 11:24:56 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:24:56 user nova-compute[75020]:       <mac address="fa:16:3e:82:a6:b9"/>
Nov 30 11:24:56 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:24:56 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:24:56 user nova-compute[75020]:       <target dev="tap03b01ff9-61"/>
Nov 30 11:24:56 user nova-compute[75020]:     </interface>
Nov 30 11:24:56 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:24:56 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/console.log" append="off"/>
Nov 30 11:24:56 user nova-compute[75020]:     </serial>
Nov 30 11:24:56 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:24:56 user nova-compute[75020]:     <video>
Nov 30 11:24:56 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:24:56 user nova-compute[75020]:     </video>
Nov 30 11:24:56 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:24:56 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:24:56 user nova-compute[75020]:     </rng>
Nov 30 11:24:56 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:24:56 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:24:56 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:24:56 user nova-compute[75020]:     </memballoon>
Nov 30 11:24:56 user nova-compute[75020]:   </devices>
Nov 30 11:24:56 user nova-compute[75020]: </domain>
Nov 30 11:24:56 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-447735209',display_name='tempest-AttachVolumeNegativeTest-server-447735209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-447735209',id=47,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6SKb9boDe/ni3P8zzyMupBeLK7ZfdiNxC1Hwqo82bBSYJ0UJeBfs0mptlrBhWFIzF0zn5JkdDZtfZfGTlt6E/CG1aVMr7o4XaNE0v4helUES+cG+5GOaej5qf0UxREFQ==',key_name='tempest-keypair-1237866748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-fapqu302',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=8512ce5f-1d19-4054-a837-4dbcebd5b7e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:a6:b9,bridge_name='br-int',has_traffic_filtering=True,id=03b01ff9-6180-4405-a448-89b353d0f1a6,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b01ff9-61') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG os_vif [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:a6:b9,bridge_name='br-int',has_traffic_filtering=True,id=03b01ff9-6180-4405-a448-89b353d0f1a6,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b01ff9-61') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1eb658bd-d01a-5c52-8da2-aedf0745dafe', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03b01ff9-61, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03b01ff9-61, col_values=(('qos', UUID('2577a456-e34c-4a15-b8c7-3104ef74e829')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03b01ff9-61, col_values=(('external_ids', {'iface-id': '03b01ff9-6180-4405-a448-89b353d0f1a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:a6:b9', 'vm-uuid': '8512ce5f-1d19-4054-a837-4dbcebd5b7e0'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:56 user nova-compute[75020]: INFO os_vif [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:a6:b9,bridge_name='br-int',has_traffic_filtering=True,id=03b01ff9-6180-4405-a448-89b353d0f1a6,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b01ff9-61')
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:24:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No VIF found with MAC fa:16:3e:82:a6:b9, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:24:57 user nova-compute[75020]: DEBUG nova.network.neutron [req-1202b59f-58c4-42e2-9ff0-6518768f8544 req-b0c016a7-dc88-4988-a544-ef54d8eac279 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Updated VIF entry in instance network info cache for port 03b01ff9-6180-4405-a448-89b353d0f1a6. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:24:57 user nova-compute[75020]: DEBUG nova.network.neutron [req-1202b59f-58c4-42e2-9ff0-6518768f8544 req-b0c016a7-dc88-4988-a544-ef54d8eac279 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Updating instance_info_cache with network_info: [{"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:24:57 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1202b59f-58c4-42e2-9ff0-6518768f8544 req-b0c016a7-dc88-4988-a544-ef54d8eac279 service nova] Releasing lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-5cc678cb-f751-4980-89bc-9c87c8538c23 req-3eda2e7a-e86c-4903-9187-7a40b39b077a service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received event network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5cc678cb-f751-4980-89bc-9c87c8538c23 req-3eda2e7a-e86c-4903-9187-7a40b39b077a service nova] Acquiring lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5cc678cb-f751-4980-89bc-9c87c8538c23 req-3eda2e7a-e86c-4903-9187-7a40b39b077a service nova] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-5cc678cb-f751-4980-89bc-9c87c8538c23 req-3eda2e7a-e86c-4903-9187-7a40b39b077a service nova] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:24:58 user nova-compute[75020]: DEBUG nova.compute.manager [req-5cc678cb-f751-4980-89bc-9c87c8538c23 req-3eda2e7a-e86c-4903-9187-7a40b39b077a service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] No waiting events found dispatching network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:24:58 user nova-compute[75020]: WARNING nova.compute.manager [req-5cc678cb-f751-4980-89bc-9c87c8538c23 req-3eda2e7a-e86c-4903-9187-7a40b39b077a service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received unexpected event network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 for instance with vm_state building and task_state spawning.
Nov 30 11:24:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:25:00 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Instance spawned successfully.
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:25:00 user nova-compute[75020]: INFO nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:25:00 user nova-compute[75020]: INFO nova.compute.manager [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Took 5.73 seconds to build instance.
Nov 30 11:25:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d1251b47-536f-4fe1-8037-938b1b478877 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.824s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-1ceead84-6c5b-41bd-91ad-7efbafa7c711 req-e9fd5af9-b503-4dc7-a69f-403ebaded017 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received event network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ceead84-6c5b-41bd-91ad-7efbafa7c711 req-e9fd5af9-b503-4dc7-a69f-403ebaded017 service nova] Acquiring lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ceead84-6c5b-41bd-91ad-7efbafa7c711 req-e9fd5af9-b503-4dc7-a69f-403ebaded017 service nova] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ceead84-6c5b-41bd-91ad-7efbafa7c711 req-e9fd5af9-b503-4dc7-a69f-403ebaded017 service nova] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:25:00 user nova-compute[75020]: DEBUG nova.compute.manager [req-1ceead84-6c5b-41bd-91ad-7efbafa7c711 req-e9fd5af9-b503-4dc7-a69f-403ebaded017 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] No waiting events found dispatching network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:25:00 user nova-compute[75020]: WARNING nova.compute.manager [req-1ceead84-6c5b-41bd-91ad-7efbafa7c711 req-e9fd5af9-b503-4dc7-a69f-403ebaded017 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received unexpected event network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 for instance with vm_state active and task_state None.
Nov 30 11:25:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:02 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:25:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:25:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:25:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:25:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:25:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:25:14 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:25:15 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:25:15 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:25:15 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.151798248291016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 8512ce5f-1d19-4054-a837-4dbcebd5b7e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:25:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:25:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:25:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:25:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:25:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:25:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:25:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:25:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:25:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:25:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:25:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:25:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:25:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:25:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:25:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:26:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:09 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:26:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:26:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:26:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:26:12 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:26:12 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Updating instance_info_cache with network_info: [{"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:26:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:26:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:26:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:26:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:17 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:26:17 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:26:17 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.149532318115234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 8512ce5f-1d19-4054-a837-4dbcebd5b7e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:26:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:26:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:26:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:26:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:26:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:26:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:26:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-ea6399de-eef9-4176-923b-83d0d1ee160c req-0eee0134-0635-4a58-a771-e77c038f33b6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received event network-changed-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:26:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-ea6399de-eef9-4176-923b-83d0d1ee160c req-0eee0134-0635-4a58-a771-e77c038f33b6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Refreshing instance network info cache due to event network-changed-03b01ff9-6180-4405-a448-89b353d0f1a6. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:26:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ea6399de-eef9-4176-923b-83d0d1ee160c req-0eee0134-0635-4a58-a771-e77c038f33b6 service nova] Acquiring lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:26:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ea6399de-eef9-4176-923b-83d0d1ee160c req-0eee0134-0635-4a58-a771-e77c038f33b6 service nova] Acquired lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:26:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-ea6399de-eef9-4176-923b-83d0d1ee160c req-0eee0134-0635-4a58-a771-e77c038f33b6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Refreshing network info cache for port 03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:26:46 user nova-compute[75020]: INFO nova.compute.manager [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Terminating instance
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Instance destroyed successfully.
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.objects.instance [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'resources' on Instance uuid 8512ce5f-1d19-4054-a837-4dbcebd5b7e0 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-447735209',display_name='tempest-AttachVolumeNegativeTest-server-447735209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-447735209',id=47,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6SKb9boDe/ni3P8zzyMupBeLK7ZfdiNxC1Hwqo82bBSYJ0UJeBfs0mptlrBhWFIzF0zn5JkdDZtfZfGTlt6E/CG1aVMr7o4XaNE0v4helUES+cG+5GOaej5qf0UxREFQ==',key_name='tempest-keypair-1237866748',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-fapqu302',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=8512ce5f-1d19-4054-a837-4dbcebd5b7e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:a6:b9,bridge_name='br-int',has_traffic_filtering=True,id=03b01ff9-6180-4405-a448-89b353d0f1a6,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b01ff9-61') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG os_vif [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:a6:b9,bridge_name='br-int',has_traffic_filtering=True,id=03b01ff9-6180-4405-a448-89b353d0f1a6,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b01ff9-61') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03b01ff9-61, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2577a456-e34c-4a15-b8c7-3104ef74e829) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:26:46 user nova-compute[75020]: INFO os_vif [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:a6:b9,bridge_name='br-int',has_traffic_filtering=True,id=03b01ff9-6180-4405-a448-89b353d0f1a6,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b01ff9-61')
Nov 30 11:26:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Deleting instance files /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0_del
Nov 30 11:26:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Deletion of /opt/stack/data/nova/instances/8512ce5f-1d19-4054-a837-4dbcebd5b7e0_del complete
Nov 30 11:26:46 user nova-compute[75020]: INFO nova.compute.manager [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 30 11:26:46 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.network.neutron [req-ea6399de-eef9-4176-923b-83d0d1ee160c req-0eee0134-0635-4a58-a771-e77c038f33b6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Updated VIF entry in instance network info cache for port 03b01ff9-6180-4405-a448-89b353d0f1a6. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG nova.network.neutron [req-ea6399de-eef9-4176-923b-83d0d1ee160c req-0eee0134-0635-4a58-a771-e77c038f33b6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Updating instance_info_cache with network_info: [{"id": "03b01ff9-6180-4405-a448-89b353d0f1a6", "address": "fa:16:3e:82:a6:b9", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b01ff9-61", "ovs_interfaceid": "03b01ff9-6180-4405-a448-89b353d0f1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:26:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-ea6399de-eef9-4176-923b-83d0d1ee160c req-0eee0134-0635-4a58-a771-e77c038f33b6 service nova] Releasing lock "refresh_cache-8512ce5f-1d19-4054-a837-4dbcebd5b7e0" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:26:47 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Took 0.77 seconds to deallocate network for instance.
Nov 30 11:26:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-da8b402b-14ab-43d7-a245-3294844510be req-5af227e9-abad-41c1-804e-234fb29d5dcd service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received event network-vif-deleted-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received event network-vif-unplugged-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] Acquiring lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] No waiting events found dispatching network-vif-unplugged-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:26:47 user nova-compute[75020]: WARNING nova.compute.manager [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received unexpected event network-vif-unplugged-03b01ff9-6180-4405-a448-89b353d0f1a6 for instance with vm_state deleted and task_state None.
Nov 30 11:26:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received event network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] Acquiring lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] No waiting events found dispatching network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:26:47 user nova-compute[75020]: WARNING nova.compute.manager [req-38f2b86f-4d77-4a28-84db-aeb9801dfd06 req-59d18bfb-7fc5-460a-bf21-eebfdb02aaf6 service nova] [instance: 8512ce5f-1d19-4054-a837-4dbcebd5b7e0] Received unexpected event network-vif-plugged-03b01ff9-6180-4405-a448-89b353d0f1a6 for instance with vm_state deleted and task_state None.
Nov 30 11:26:47 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:26:47 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Deleted allocations for instance 8512ce5f-1d19-4054-a837-4dbcebd5b7e0
Nov 30 11:26:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-4c2442b9-f959-4159-b5ce-10cf233df113 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "8512ce5f-1d19-4054-a837-4dbcebd5b7e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.782s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:26:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:26:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:03 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:27:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:27:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:27:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:27:16 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:27:16 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9052MB free_disk=25.17666244506836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:27:16 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:27:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:27:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:27:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:27:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:27:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:27:37 user nova-compute[75020]: INFO nova.compute.manager [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Detaching volume cf1674b8-4c83-4dbc-b3f7-964743e235ef
Nov 30 11:27:37 user nova-compute[75020]: INFO nova.virt.block_device [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Attempting to driver detach volume cf1674b8-4c83-4dbc-b3f7-964743e235ef from mountpoint /dev/vdb
Nov 30 11:27:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Attempting to detach device vdb from instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:27:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:27:37 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:27:37 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:27:37 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:27:37 user nova-compute[75020]:   <serial>cf1674b8-4c83-4dbc-b3f7-964743e235ef</serial>
Nov 30 11:27:37 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:27:37 user nova-compute[75020]: </disk>
Nov 30 11:27:37 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:27:37 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully detached device vdb from instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 from the persistent domain config.
Nov 30 11:27:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:27:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:27:37 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:27:37 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:27:37 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:27:37 user nova-compute[75020]:   <serial>cf1674b8-4c83-4dbc-b3f7-964743e235ef</serial>
Nov 30 11:27:37 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:27:37 user nova-compute[75020]: </disk>
Nov 30 11:27:37 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:27:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:27:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:27:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:27:58 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 is timed out.
Nov 30 11:27:58 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully detached device vdb from instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 from the live domain config.
Nov 30 11:27:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUwkSYXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:27:58 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb92bcc5-455f-4d28-bc42-dfc0cfd9963c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:27:58 user nova-compute[75020]: No targets found.
Nov 30 11:27:58 user nova-compute[75020]: iSNS:
Nov 30 11:27:58 user nova-compute[75020]: No targets found.
Nov 30 11:27:58 user nova-compute[75020]: STATIC:
Nov 30 11:27:58 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef
Nov 30 11:27:58 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:27:58 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:27:58 user nova-compute[75020]: FIRMWARE:
Nov 30 11:27:58 user nova-compute[75020]: No targets found.
Nov 30 11:27:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:27:58 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:27:58 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ec7c4-25fe-4fdd-974a-4f534f9843e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ccd7a-35a7-4dc4-86b0-1509143d5210]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef (non-flash)
Nov 30 11:27:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef (non-flash)
Nov 30 11:27:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada87dc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a2b27d-9691-44d4-87c3-652628fc47f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5c99ba-3991-4e2c-a526-9ce9b169d1e9]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d740dd-7395-4393-97f2-b5d381f4a48f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[65af34b4-d2cc-4004-a0e5-192f289e9c69]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd76a7e1-e159-4cb3-8397-f8a1a99f469b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5519ca99-dd73-4bdd-80b1-8071f28aaee1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef, portal: 172.16.0.220,3260]
Nov 30 11:27:58 user nova-compute[75020]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef, portal: 172.16.0.220,3260] successful.
Nov 30 11:27:58 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1674b8-4c83-4dbc-b3f7-964743e235ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2c510b-335b-4493-bad5-30d525b8054d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== disconnect_volume: return (275ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:27:58 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:27:59 user nova-compute[75020]: DEBUG nova.objects.instance [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:27:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-02194654-7293-4b28-bdbf-b18fa48e41ff tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.060s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:28:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [{"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-5d623399-705b-4ebf-8bd1-13f6e2dbbc97" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:28:15 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:28:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:28:18 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:28:18 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:28:18 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9067MB free_disk=25.175922393798828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:28:18 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:28:19 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:28:19 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:28:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:28:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:28:28 user nova-compute[75020]: INFO nova.compute.manager [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Terminating instance
Nov 30 11:28:28 user nova-compute[75020]: DEBUG nova.compute.manager [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-dddae5ea-95db-48ee-8419-024de09f3611 req-81974714-972a-4f93-a94d-a20590690323 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received event network-vif-unplugged-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dddae5ea-95db-48ee-8419-024de09f3611 req-81974714-972a-4f93-a94d-a20590690323 service nova] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dddae5ea-95db-48ee-8419-024de09f3611 req-81974714-972a-4f93-a94d-a20590690323 service nova] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-dddae5ea-95db-48ee-8419-024de09f3611 req-81974714-972a-4f93-a94d-a20590690323 service nova] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-dddae5ea-95db-48ee-8419-024de09f3611 req-81974714-972a-4f93-a94d-a20590690323 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] No waiting events found dispatching network-vif-unplugged-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG nova.compute.manager [req-dddae5ea-95db-48ee-8419-024de09f3611 req-81974714-972a-4f93-a94d-a20590690323 service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received event network-vif-unplugged-d78cf676-82a6-40aa-b23f-f222a4d6591a for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Instance destroyed successfully.
Nov 30 11:28:28 user nova-compute[75020]: DEBUG nova.objects.instance [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'resources' on Instance uuid 5d623399-705b-4ebf-8bd1-13f6e2dbbc97 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1321673704',display_name='tempest-AttachVolumeNegativeTest-server-1321673704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1321673704',id=46,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6We1JPfpnSyo84oq/gIogDWcUbW7lzB3GXG30r6G8a6fzbLPYBOQv19b8VhWlJtjp10CMkiayVRetk92+yG82ezDZSeJXYFMeQgcRz56n2Gep1i8Pe3Gz9iNvqtoqg+A==',key_name='tempest-keypair-1723291603',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-cbsvz3uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:22:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=5d623399-705b-4ebf-8bd1-13f6e2dbbc97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "address": "fa:16:3e:d2:14:7c", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78cf676-82", "ovs_interfaceid": "d78cf676-82a6-40aa-b23f-f222a4d6591a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=d78cf676-82a6-40aa-b23f-f222a4d6591a,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78cf676-82') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG os_vif [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=d78cf676-82a6-40aa-b23f-f222a4d6591a,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78cf676-82') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd78cf676-82, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c6bbfe7-a1ab-45e7-892e-76abdd05058f) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:28 user nova-compute[75020]: INFO os_vif [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=d78cf676-82a6-40aa-b23f-f222a4d6591a,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78cf676-82')
Nov 30 11:28:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Deleting instance files /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97_del
Nov 30 11:28:28 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Deletion of /opt/stack/data/nova/instances/5d623399-705b-4ebf-8bd1-13f6e2dbbc97_del complete
Nov 30 11:28:29 user nova-compute[75020]: INFO nova.compute.manager [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 30 11:28:29 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:28:29 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:28:29 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:28:29 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:28:29 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Took 0.85 seconds to deallocate network for instance.
Nov 30 11:28:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:28:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:28:30 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:28:30 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:28:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:28:30 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Deleted allocations for instance 5d623399-705b-4ebf-8bd1-13f6e2dbbc97
Nov 30 11:28:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-cb889df7-59f6-496e-99f5-64e4691ecec9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:28:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-56e3082a-cef0-4a8a-98b8-76968bd7dd5d req-0452d63a-c480-4a58-be6c-c7789783dcae service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received event network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:28:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-56e3082a-cef0-4a8a-98b8-76968bd7dd5d req-0452d63a-c480-4a58-be6c-c7789783dcae service nova] Acquiring lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:28:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-56e3082a-cef0-4a8a-98b8-76968bd7dd5d req-0452d63a-c480-4a58-be6c-c7789783dcae service nova] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:28:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-56e3082a-cef0-4a8a-98b8-76968bd7dd5d req-0452d63a-c480-4a58-be6c-c7789783dcae service nova] Lock "5d623399-705b-4ebf-8bd1-13f6e2dbbc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:28:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-56e3082a-cef0-4a8a-98b8-76968bd7dd5d req-0452d63a-c480-4a58-be6c-c7789783dcae service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] No waiting events found dispatching network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:28:30 user nova-compute[75020]: WARNING nova.compute.manager [req-56e3082a-cef0-4a8a-98b8-76968bd7dd5d req-0452d63a-c480-4a58-be6c-c7789783dcae service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received unexpected event network-vif-plugged-d78cf676-82a6-40aa-b23f-f222a4d6591a for instance with vm_state deleted and task_state None.
Nov 30 11:28:30 user nova-compute[75020]: DEBUG nova.compute.manager [req-56e3082a-cef0-4a8a-98b8-76968bd7dd5d req-0452d63a-c480-4a58-be6c-c7789783dcae service nova] [instance: 5d623399-705b-4ebf-8bd1-13f6e2dbbc97] Received event network-vif-deleted-d78cf676-82a6-40aa-b23f-f222a4d6591a {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:28:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:28:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:28:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:28:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:28:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:28:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:28:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:28:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:28:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:28:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:28:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:28:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:28:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:29:11 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:11 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:29:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:29:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:29:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:29:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:29:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:29:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:29:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9210MB free_disk=25.195194244384766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:29:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:29:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:21 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:29:21 user nova-compute[75020]: INFO nova.compute.claims [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Claim successful on node user
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:29:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.policy [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80403fda7f794fc79a9b7fdfb3297c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb663b4ea574c5aaab1acc6f9d7c3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:29:22 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Creating image(s)
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "/opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "/opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "/opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.177s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk 1073741824" returned: 0 in 0.063s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:29:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Successfully created port: 364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Cannot resize image /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Ensure instance console log exists: /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Successfully updated port: 364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquired lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-d0c3e333-de22-4754-a2aa-e9250fa84859 req-8cc40216-25d0-4ffb-932a-05c514557cff service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-changed-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.compute.manager [req-d0c3e333-de22-4754-a2aa-e9250fa84859 req-8cc40216-25d0-4ffb-932a-05c514557cff service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Refreshing instance network info cache due to event network-changed-364b7aea-11d3-4072-a2eb-e36a759fa712. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0c3e333-de22-4754-a2aa-e9250fa84859 req-8cc40216-25d0-4ffb-932a-05c514557cff service nova] Acquiring lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updating instance_info_cache with network_info: [{"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Releasing lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Instance network_info: |[{"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0c3e333-de22-4754-a2aa-e9250fa84859 req-8cc40216-25d0-4ffb-932a-05c514557cff service nova] Acquired lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.neutron [req-d0c3e333-de22-4754-a2aa-e9250fa84859 req-8cc40216-25d0-4ffb-932a-05c514557cff service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Refreshing network info cache for port 364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Start _get_guest_xml network_info=[{"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:29:23 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:29:23 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-342737962',display_name='tempest-AttachVolumeNegativeTest-server-342737962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-342737962',id=48,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjaLcei+5iHH2842nIgvlcHYruasrIQdLd0YH/lC22H29xWE4cTt96BZan3QXa0QvpWkeOB02rR7JhwsQo/R+xSwOYWxX8qaEwhPah4B8RPjpYOBdWXct1i4M8ltCNHWA==',key_name='tempest-keypair-1575028481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-e840zqus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:29:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=53f3c994-31d3-4cea-9cfe-b1d7f792be78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ac:e3,bridge_name='br-int',has_traffic_filtering=True,id=364b7aea-11d3-4072-a2eb-e36a759fa712,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b7aea-11') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.objects.instance [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'pci_devices' on Instance uuid 53f3c994-31d3-4cea-9cfe-b1d7f792be78 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:29:23 user nova-compute[75020]:   <uuid>53f3c994-31d3-4cea-9cfe-b1d7f792be78</uuid>
Nov 30 11:29:23 user nova-compute[75020]:   <name>instance-00000030</name>
Nov 30 11:29:23 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:29:23 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:29:23 user nova-compute[75020]:   <metadata>
Nov 30 11:29:23 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:29:23 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:29:23 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeNegativeTest-server-342737962</nova:name>
Nov 30 11:29:23 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:29:23</nova:creationTime>
Nov 30 11:29:23 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:29:23 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:29:23 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:29:23 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:29:23 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:29:23 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:29:23 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:29:23 user nova-compute[75020]:       <nova:owner>
Nov 30 11:29:23 user nova-compute[75020]:         <nova:user uuid="80403fda7f794fc79a9b7fdfb3297c72">tempest-AttachVolumeNegativeTest-560525472-project-member</nova:user>
Nov 30 11:29:23 user nova-compute[75020]:         <nova:project uuid="5fb663b4ea574c5aaab1acc6f9d7c3a2">tempest-AttachVolumeNegativeTest-560525472</nova:project>
Nov 30 11:29:23 user nova-compute[75020]:       </nova:owner>
Nov 30 11:29:23 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:29:23 user nova-compute[75020]:       <nova:ports>
Nov 30 11:29:23 user nova-compute[75020]:         <nova:port uuid="364b7aea-11d3-4072-a2eb-e36a759fa712">
Nov 30 11:29:23 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 11:29:23 user nova-compute[75020]:         </nova:port>
Nov 30 11:29:23 user nova-compute[75020]:       </nova:ports>
Nov 30 11:29:23 user nova-compute[75020]:     </nova:instance>
Nov 30 11:29:23 user nova-compute[75020]:   </metadata>
Nov 30 11:29:23 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:29:23 user nova-compute[75020]:     <system>
Nov 30 11:29:23 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:29:23 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:29:23 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:29:23 user nova-compute[75020]:       <entry name="serial">53f3c994-31d3-4cea-9cfe-b1d7f792be78</entry>
Nov 30 11:29:23 user nova-compute[75020]:       <entry name="uuid">53f3c994-31d3-4cea-9cfe-b1d7f792be78</entry>
Nov 30 11:29:23 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:29:23 user nova-compute[75020]:     </system>
Nov 30 11:29:23 user nova-compute[75020]:   </sysinfo>
Nov 30 11:29:23 user nova-compute[75020]:   <os>
Nov 30 11:29:23 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:29:23 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:29:23 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:29:23 user nova-compute[75020]:   </os>
Nov 30 11:29:23 user nova-compute[75020]:   <features>
Nov 30 11:29:23 user nova-compute[75020]:     <acpi/>
Nov 30 11:29:23 user nova-compute[75020]:     <apic/>
Nov 30 11:29:23 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:29:23 user nova-compute[75020]:   </features>
Nov 30 11:29:23 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:29:23 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:29:23 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:29:23 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:29:23 user nova-compute[75020]:   </clock>
Nov 30 11:29:23 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:29:23 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:29:23 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:29:23 user nova-compute[75020]:   </cpu>
Nov 30 11:29:23 user nova-compute[75020]:   <devices>
Nov 30 11:29:23 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:29:23 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:29:23 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk"/>
Nov 30 11:29:23 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:29:23 user nova-compute[75020]:     </disk>
Nov 30 11:29:23 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:29:23 user nova-compute[75020]:       <mac address="fa:16:3e:7c:ac:e3"/>
Nov 30 11:29:23 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:29:23 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:29:23 user nova-compute[75020]:       <target dev="tap364b7aea-11"/>
Nov 30 11:29:23 user nova-compute[75020]:     </interface>
Nov 30 11:29:23 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:29:23 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/console.log" append="off"/>
Nov 30 11:29:23 user nova-compute[75020]:     </serial>
Nov 30 11:29:23 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:29:23 user nova-compute[75020]:     <video>
Nov 30 11:29:23 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:29:23 user nova-compute[75020]:     </video>
Nov 30 11:29:23 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:29:23 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:29:23 user nova-compute[75020]:     </rng>
Nov 30 11:29:23 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:29:23 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:29:23 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:29:23 user nova-compute[75020]:     </memballoon>
Nov 30 11:29:23 user nova-compute[75020]:   </devices>
Nov 30 11:29:23 user nova-compute[75020]: </domain>
Nov 30 11:29:23 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-342737962',display_name='tempest-AttachVolumeNegativeTest-server-342737962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-342737962',id=48,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjaLcei+5iHH2842nIgvlcHYruasrIQdLd0YH/lC22H29xWE4cTt96BZan3QXa0QvpWkeOB02rR7JhwsQo/R+xSwOYWxX8qaEwhPah4B8RPjpYOBdWXct1i4M8ltCNHWA==',key_name='tempest-keypair-1575028481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-e840zqus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:29:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=53f3c994-31d3-4cea-9cfe-b1d7f792be78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ac:e3,bridge_name='br-int',has_traffic_filtering=True,id=364b7aea-11d3-4072-a2eb-e36a759fa712,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b7aea-11') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG os_vif [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ac:e3,bridge_name='br-int',has_traffic_filtering=True,id=364b7aea-11d3-4072-a2eb-e36a759fa712,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b7aea-11') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '328b6221-35be-5dd9-8a2e-bdc175a87ccd', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap364b7aea-11, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap364b7aea-11, col_values=(('qos', UUID('0fcc27f7-d38a-4a99-9fb5-d17cd9504e00')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap364b7aea-11, col_values=(('external_ids', {'iface-id': '364b7aea-11d3-4072-a2eb-e36a759fa712', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:ac:e3', 'vm-uuid': '53f3c994-31d3-4cea-9cfe-b1d7f792be78'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:29:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:23 user nova-compute[75020]: INFO os_vif [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ac:e3,bridge_name='br-int',has_traffic_filtering=True,id=364b7aea-11d3-4072-a2eb-e36a759fa712,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b7aea-11')
Nov 30 11:29:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:29:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No VIF found with MAC fa:16:3e:7c:ac:e3, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:29:24 user nova-compute[75020]: DEBUG nova.network.neutron [req-d0c3e333-de22-4754-a2aa-e9250fa84859 req-8cc40216-25d0-4ffb-932a-05c514557cff service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updated VIF entry in instance network info cache for port 364b7aea-11d3-4072-a2eb-e36a759fa712. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:29:24 user nova-compute[75020]: DEBUG nova.network.neutron [req-d0c3e333-de22-4754-a2aa-e9250fa84859 req-8cc40216-25d0-4ffb-932a-05c514557cff service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updating instance_info_cache with network_info: [{"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:29:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d0c3e333-de22-4754-a2aa-e9250fa84859 req-8cc40216-25d0-4ffb-932a-05c514557cff service nova] Releasing lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c6ee66c-93bb-4fdd-90ae-2d499cfe27cd req-4e5624db-6045-47c1-bf3c-e7d2f9281932 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c6ee66c-93bb-4fdd-90ae-2d499cfe27cd req-4e5624db-6045-47c1-bf3c-e7d2f9281932 service nova] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c6ee66c-93bb-4fdd-90ae-2d499cfe27cd req-4e5624db-6045-47c1-bf3c-e7d2f9281932 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-6c6ee66c-93bb-4fdd-90ae-2d499cfe27cd req-4e5624db-6045-47c1-bf3c-e7d2f9281932 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG nova.compute.manager [req-6c6ee66c-93bb-4fdd-90ae-2d499cfe27cd req-4e5624db-6045-47c1-bf3c-e7d2f9281932 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] No waiting events found dispatching network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:29:25 user nova-compute[75020]: WARNING nova.compute.manager [req-6c6ee66c-93bb-4fdd-90ae-2d499cfe27cd req-4e5624db-6045-47c1-bf3c-e7d2f9281932 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received unexpected event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 for instance with vm_state building and task_state spawning.
Nov 30 11:29:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:29:27 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Instance spawned successfully.
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:29:27 user nova-compute[75020]: INFO nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.compute.manager [req-105fb63f-4f9c-4cca-8387-45c937966b7f req-1cc10feb-9f04-466a-bf72-bcaefce67947 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-105fb63f-4f9c-4cca-8387-45c937966b7f req-1cc10feb-9f04-466a-bf72-bcaefce67947 service nova] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-105fb63f-4f9c-4cca-8387-45c937966b7f req-1cc10feb-9f04-466a-bf72-bcaefce67947 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-105fb63f-4f9c-4cca-8387-45c937966b7f req-1cc10feb-9f04-466a-bf72-bcaefce67947 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:27 user nova-compute[75020]: DEBUG nova.compute.manager [req-105fb63f-4f9c-4cca-8387-45c937966b7f req-1cc10feb-9f04-466a-bf72-bcaefce67947 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] No waiting events found dispatching network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:29:27 user nova-compute[75020]: WARNING nova.compute.manager [req-105fb63f-4f9c-4cca-8387-45c937966b7f req-1cc10feb-9f04-466a-bf72-bcaefce67947 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received unexpected event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 for instance with vm_state building and task_state spawning.
Nov 30 11:29:27 user nova-compute[75020]: INFO nova.compute.manager [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Took 5.80 seconds to build instance.
Nov 30 11:29:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-35bdbe7d-05a2-47e2-a1ba-49079f75daaa tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.901s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:29:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:29:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:29:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:29:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:29:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:06 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:30:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:11 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 53f3c994-31d3-4cea-9cfe-b1d7f792be78 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updating instance_info_cache with network_info: [{"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:30:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:30:19 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:30:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:30:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:30:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:30:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=25.165660858154297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:30:20 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:30:21 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:30:21 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:30:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:30:23 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:30:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:30:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:30:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:30:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:30:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:30:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:30:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:30:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:30:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:31:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:31:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:31:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:31:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:11 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-eed74ce7-af49-48f7-9254-b8f7f814c67d req-bfe23d93-1345-4398-9ad3-86f5d97b067c service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-changed-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:31:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-eed74ce7-af49-48f7-9254-b8f7f814c67d req-bfe23d93-1345-4398-9ad3-86f5d97b067c service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Refreshing instance network info cache due to event network-changed-364b7aea-11d3-4072-a2eb-e36a759fa712. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:31:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eed74ce7-af49-48f7-9254-b8f7f814c67d req-bfe23d93-1345-4398-9ad3-86f5d97b067c service nova] Acquiring lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:31:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eed74ce7-af49-48f7-9254-b8f7f814c67d req-bfe23d93-1345-4398-9ad3-86f5d97b067c service nova] Acquired lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:31:13 user nova-compute[75020]: DEBUG nova.network.neutron [req-eed74ce7-af49-48f7-9254-b8f7f814c67d req-bfe23d93-1345-4398-9ad3-86f5d97b067c service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Refreshing network info cache for port 364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:31:13 user nova-compute[75020]: DEBUG nova.network.neutron [req-eed74ce7-af49-48f7-9254-b8f7f814c67d req-bfe23d93-1345-4398-9ad3-86f5d97b067c service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updated VIF entry in instance network info cache for port 364b7aea-11d3-4072-a2eb-e36a759fa712. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:31:13 user nova-compute[75020]: DEBUG nova.network.neutron [req-eed74ce7-af49-48f7-9254-b8f7f814c67d req-bfe23d93-1345-4398-9ad3-86f5d97b067c service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updating instance_info_cache with network_info: [{"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:31:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eed74ce7-af49-48f7-9254-b8f7f814c67d req-bfe23d93-1345-4398-9ad3-86f5d97b067c service nova] Releasing lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:31:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:31:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:31:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:31:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:31:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:31:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:31:15 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid 53f3c994-31d3-4cea-9cfe-b1d7f792be78 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:31:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:31:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:31:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:31:15 user nova-compute[75020]: INFO nova.compute.manager [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Attaching volume 887f9476-5fc5-4dae-97d9-2d1acbdd4329 to /dev/vdb
Nov 30 11:31:15 user nova-compute[75020]: DEBUG os_brick.utils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95f21c7-9c56-47a3-8957-47584734ce27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb48617b-704c-496f-97f1-27bcad5abf97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81bef4d-5a85-4860-a719-857a787606e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2d848d-d35d-402a-a8bc-6eca775c8b1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:31:16 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:31:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e677e8a-32d1-4155-aba2-40daaea5fa95]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG os_brick.utils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:31:16 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updating existing volume attachment record: ce7e0991-8dcb-4d11-91ff-75569fa13b77 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:31:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 53f3c994-31d3-4cea-9cfe-b1d7f792be78 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updating instance_info_cache with network_info: [{"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-53f3c994-31d3-4cea-9cfe-b1d7f792be78" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:31:18 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:31:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:31:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:31:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=25.164871215820312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:31:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:31:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxFtZdvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:31:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:31:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:31:24 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f33ab7-aab0-476a-b5f4-db600fc46706]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:31:24 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcfbc74-1f34-420a-a71d-16afbaa0340d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329] added
Nov 30 11:31:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0ba677-97b0-44a9-9ef3-9134ee8edcb6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b991eda-33d3-441c-ab99-688cd0019643]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxFtZdvS {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxFtZdvS" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d4341f-266d-42e5-b13a-9fc53ed24995]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QxFtZdvS'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[89599a49-fd3a-41a8-9854-dbf4688566d2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7049be40-6122-458b-a5c3-71947b6a6c15]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:31:24 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:31:24 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:31:24 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:31:24 user nova-compute[75020]: 
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[59534bb9-5b2d-45e3-83a4-467b940dca5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329, portal: 172.16.0.220,3260]
Nov 30 11:31:24 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329, portal: 172.16.0.220,3260] successful.
Nov 30 11:31:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7190d85f-2f02-44eb-a252-a9ff5642997e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[35450fd2-52be-40f6-b34d-951a4812b8c2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 (non-flash)
Nov 30 11:31:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 (non-flash)
Nov 30 11:31:24 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73cac29-0f15-4ef5-bc13-4a62a432c6ae]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:31:24 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxFtZdvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:31:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:31:25 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26162383033316136', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:31:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162383033316136', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:31:25 user nova-compute[75020]: DEBUG nova.objects.instance [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid 53f3c994-31d3-4cea-9cfe-b1d7f792be78 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:31:25 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:31:25 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:31:25 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:31:25 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:31:25 user nova-compute[75020]:   <serial>887f9476-5fc5-4dae-97d9-2d1acbdd4329</serial>
Nov 30 11:31:25 user nova-compute[75020]: </disk>
Nov 30 11:31:25 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:31:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:31:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:31:26 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No VIF found with MAC fa:16:3e:7c:ac:e3, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:31:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-d04f861b-8adf-4434-8391-f2435d669489 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.320s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:31:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:31:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:31:26 user nova-compute[75020]: INFO nova.compute.manager [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Detaching volume 887f9476-5fc5-4dae-97d9-2d1acbdd4329
Nov 30 11:31:27 user nova-compute[75020]: INFO nova.virt.block_device [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Attempting to driver detach volume 887f9476-5fc5-4dae-97d9-2d1acbdd4329 from mountpoint /dev/vdb
Nov 30 11:31:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Attempting to detach device vdb from instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:31:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:31:27 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:31:27 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:31:27 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:31:27 user nova-compute[75020]:   <serial>887f9476-5fc5-4dae-97d9-2d1acbdd4329</serial>
Nov 30 11:31:27 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:31:27 user nova-compute[75020]: </disk>
Nov 30 11:31:27 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:31:27 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully detached device vdb from instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 from the persistent domain config.
Nov 30 11:31:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:31:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:31:27 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:31:27 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:31:27 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:31:27 user nova-compute[75020]:   <serial>887f9476-5fc5-4dae-97d9-2d1acbdd4329</serial>
Nov 30 11:31:27 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:31:27 user nova-compute[75020]: </disk>
Nov 30 11:31:27 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:31:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:31:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:31:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:31:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:31:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:31:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:31:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:47 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 is timed out.
Nov 30 11:31:47 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully detached device vdb from instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 from the live domain config.
Nov 30 11:31:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxFtZdvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:31:47 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc09f3a-dfea-4541-9d46-db087541ddac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:31:47 user nova-compute[75020]: No targets found.
Nov 30 11:31:47 user nova-compute[75020]: iSNS:
Nov 30 11:31:47 user nova-compute[75020]: No targets found.
Nov 30 11:31:47 user nova-compute[75020]: STATIC:
Nov 30 11:31:47 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329
Nov 30 11:31:47 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:31:47 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:31:47 user nova-compute[75020]: FIRMWARE:
Nov 30 11:31:47 user nova-compute[75020]: No targets found.
Nov 30 11:31:47 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:31:47 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:31:47 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d66a72d-5f73-4add-a8c1-5f1657deaddb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f9e42-f027-4ceb-9eca-a4f5330695fc]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 (non-flash)
Nov 30 11:31:47 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 (non-flash)
Nov 30 11:31:47 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad887d68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f270aca7-c6d8-4c3c-a4da-99372f57a9c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccffd86-a034-4ec4-adc5-cbcb68b163a2]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f281f-4033-499d-be89-12ff750bb4b0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6996c61d-25de-4513-b10b-635664b5a01f]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3728b546-c2d2-4f11-91d9-2ae85070943e]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[151a0532-8030-4e19-91e1-7f1e965c308c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329, portal: 172.16.0.220,3260]
Nov 30 11:31:47 user nova-compute[75020]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329, portal: 172.16.0.220,3260] successful.
Nov 30 11:31:47 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f9476-5fc5-4dae-97d9-2d1acbdd4329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[627cc219-0067-4123-9866-5d70007a7a6f]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== disconnect_volume: return (303ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:31:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:31:48 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid 53f3c994-31d3-4cea-9cfe-b1d7f792be78 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:31:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb9108fe-c9a8-41e0-9500-60ae0d28ac14 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:31:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:31:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:31:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:31:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:31:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:31:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:31:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:32:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:32:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:32:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:17 user nova-compute[75020]: INFO nova.compute.manager [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Terminating instance
Nov 30 11:32:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-f44a3553-5e2c-45ad-9c18-45fb1e1096ab req-c8b071dd-ced2-41e1-a1ba-b262d89762db service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-unplugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f44a3553-5e2c-45ad-9c18-45fb1e1096ab req-c8b071dd-ced2-41e1-a1ba-b262d89762db service nova] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f44a3553-5e2c-45ad-9c18-45fb1e1096ab req-c8b071dd-ced2-41e1-a1ba-b262d89762db service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f44a3553-5e2c-45ad-9c18-45fb1e1096ab req-c8b071dd-ced2-41e1-a1ba-b262d89762db service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-f44a3553-5e2c-45ad-9c18-45fb1e1096ab req-c8b071dd-ced2-41e1-a1ba-b262d89762db service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] No waiting events found dispatching network-vif-unplugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-f44a3553-5e2c-45ad-9c18-45fb1e1096ab req-c8b071dd-ced2-41e1-a1ba-b262d89762db service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-unplugged-364b7aea-11d3-4072-a2eb-e36a759fa712 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:32:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Instance destroyed successfully.
Nov 30 11:32:18 user nova-compute[75020]: DEBUG nova.objects.instance [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'resources' on Instance uuid 53f3c994-31d3-4cea-9cfe-b1d7f792be78 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-342737962',display_name='tempest-AttachVolumeNegativeTest-server-342737962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-342737962',id=48,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjaLcei+5iHH2842nIgvlcHYruasrIQdLd0YH/lC22H29xWE4cTt96BZan3QXa0QvpWkeOB02rR7JhwsQo/R+xSwOYWxX8qaEwhPah4B8RPjpYOBdWXct1i4M8ltCNHWA==',key_name='tempest-keypair-1575028481',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:29:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-e840zqus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=53f3c994-31d3-4cea-9cfe-b1d7f792be78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "364b7aea-11d3-4072-a2eb-e36a759fa712", "address": "fa:16:3e:7c:ac:e3", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b7aea-11", "ovs_interfaceid": "364b7aea-11d3-4072-a2eb-e36a759fa712", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ac:e3,bridge_name='br-int',has_traffic_filtering=True,id=364b7aea-11d3-4072-a2eb-e36a759fa712,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b7aea-11') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG os_vif [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ac:e3,bridge_name='br-int',has_traffic_filtering=True,id=364b7aea-11d3-4072-a2eb-e36a759fa712,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b7aea-11') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap364b7aea-11, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fcc27f7-d38a-4a99-9fb5-d17cd9504e00) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: INFO os_vif [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ac:e3,bridge_name='br-int',has_traffic_filtering=True,id=364b7aea-11d3-4072-a2eb-e36a759fa712,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b7aea-11')
Nov 30 11:32:18 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Deleting instance files /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78_del
Nov 30 11:32:18 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Deletion of /opt/stack/data/nova/instances/53f3c994-31d3-4cea-9cfe-b1d7f792be78_del complete
Nov 30 11:32:18 user nova-compute[75020]: INFO nova.compute.manager [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 11:32:18 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-1582f3b4-de79-4979-88a2-ee2e5281f612 req-fd6a04fa-cbeb-4709-86fd-10fa75309e9f service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-deleted-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:32:19 user nova-compute[75020]: INFO nova.compute.manager [req-1582f3b4-de79-4979-88a2-ee2e5281f612 req-fd6a04fa-cbeb-4709-86fd-10fa75309e9f service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Neutron deleted interface 364b7aea-11d3-4072-a2eb-e36a759fa712; detaching it from the instance and deleting it from the info cache
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.network.neutron [req-1582f3b4-de79-4979-88a2-ee2e5281f612 req-fd6a04fa-cbeb-4709-86fd-10fa75309e9f service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:32:19 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Took 0.90 seconds to deallocate network for instance.
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-1582f3b4-de79-4979-88a2-ee2e5281f612 req-fd6a04fa-cbeb-4709-86fd-10fa75309e9f service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Detach interface failed, port_id=364b7aea-11d3-4072-a2eb-e36a759fa712, reason: Instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78 could not be found. {{(pid=75020) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:19 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Deleted allocations for instance 53f3c994-31d3-4cea-9cfe-b1d7f792be78
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-38acf991-e029-4dbc-8cfd-53ea4c187f97 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.071s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] No waiting events found dispatching network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:32:19 user nova-compute[75020]: WARNING nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received unexpected event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 for instance with vm_state deleted and task_state None.
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] No waiting events found dispatching network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:32:19 user nova-compute[75020]: WARNING nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received unexpected event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 for instance with vm_state deleted and task_state None.
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] No waiting events found dispatching network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:32:19 user nova-compute[75020]: WARNING nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received unexpected event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 for instance with vm_state deleted and task_state None.
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-unplugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] No waiting events found dispatching network-vif-unplugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:32:19 user nova-compute[75020]: WARNING nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received unexpected event network-vif-unplugged-364b7aea-11d3-4072-a2eb-e36a759fa712 for instance with vm_state deleted and task_state None.
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Acquiring lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] Lock "53f3c994-31d3-4cea-9cfe-b1d7f792be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:19 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] No waiting events found dispatching network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:32:19 user nova-compute[75020]: WARNING nova.compute.manager [req-cf58abd4-6f7e-4835-ad07-36b3ea2bc0d5 req-c4ba4880-2509-44af-a362-752adff57f98 service nova] [instance: 53f3c994-31d3-4cea-9cfe-b1d7f792be78] Received unexpected event network-vif-plugged-364b7aea-11d3-4072-a2eb-e36a759fa712 for instance with vm_state deleted and task_state None.
Nov 30 11:32:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:32:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:32:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=25.19174575805664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:32:20 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:32:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:23 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:24 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:32:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:32:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:32:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:32:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:32:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:32:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:32:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:32:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:32:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:32:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:32:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:32:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:32:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:33:08 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:33:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:33:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:33:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:33:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:33:11 user nova-compute[75020]: INFO nova.compute.claims [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Claim successful on node user
Nov 30 11:33:11 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:33:11 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:33:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.policy [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80403fda7f794fc79a9b7fdfb3297c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb663b4ea574c5aaab1acc6f9d7c3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:33:12 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Creating image(s)
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "/opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "/opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk 1073741824" returned: 0 in 0.049s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Successfully created port: 7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Cannot resize image /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Ensure instance console log exists: /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Successfully updated port: 7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquired lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-9f0fa17a-bbc3-43c9-9f6f-ab1221744c20 req-24ae6c6c-6175-4efe-b54b-ff10097789b7 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received event network-changed-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.compute.manager [req-9f0fa17a-bbc3-43c9-9f6f-ab1221744c20 req-24ae6c6c-6175-4efe-b54b-ff10097789b7 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Refreshing instance network info cache due to event network-changed-7035cee4-9a11-47f4-9b8e-2ee775acd580. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9f0fa17a-bbc3-43c9-9f6f-ab1221744c20 req-24ae6c6c-6175-4efe-b54b-ff10097789b7 service nova] Acquiring lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updating instance_info_cache with network_info: [{"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Releasing lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Instance network_info: |[{"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9f0fa17a-bbc3-43c9-9f6f-ab1221744c20 req-24ae6c6c-6175-4efe-b54b-ff10097789b7 service nova] Acquired lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.neutron [req-9f0fa17a-bbc3-43c9-9f6f-ab1221744c20 req-24ae6c6c-6175-4efe-b54b-ff10097789b7 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Refreshing network info cache for port 7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Start _get_guest_xml network_info=[{"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:33:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:33:13 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1791802490',display_name='tempest-AttachVolumeNegativeTest-server-1791802490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1791802490',id=49,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw5Rg3QMHoaEaErFjIpkqB7hr+MdPDWtmlrO2nzNtf4a5Pg3Qpb5n/3b1fPHDF8MT4tQIu+caZN8vSYTOzxmjr8kpsWz6A32AmAbpJU0bGmPjFqCF5Kh3pGV+0D7nAA7Q==',key_name='tempest-keypair-1738053290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-7p402wav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=e2e9adff-1793-423e-90fa-2f896ab62ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:43:97,bridge_name='br-int',has_traffic_filtering=True,id=7035cee4-9a11-47f4-9b8e-2ee775acd580,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7035cee4-9a') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'pci_devices' on Instance uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:33:13 user nova-compute[75020]:   <uuid>e2e9adff-1793-423e-90fa-2f896ab62ce7</uuid>
Nov 30 11:33:13 user nova-compute[75020]:   <name>instance-00000031</name>
Nov 30 11:33:13 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:33:13 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:33:13 user nova-compute[75020]:   <metadata>
Nov 30 11:33:13 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:33:13 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:33:13 user nova-compute[75020]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1791802490</nova:name>
Nov 30 11:33:13 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:33:13</nova:creationTime>
Nov 30 11:33:13 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:33:13 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:33:13 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:33:13 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:33:13 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:33:13 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:33:13 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:33:13 user nova-compute[75020]:       <nova:owner>
Nov 30 11:33:13 user nova-compute[75020]:         <nova:user uuid="80403fda7f794fc79a9b7fdfb3297c72">tempest-AttachVolumeNegativeTest-560525472-project-member</nova:user>
Nov 30 11:33:13 user nova-compute[75020]:         <nova:project uuid="5fb663b4ea574c5aaab1acc6f9d7c3a2">tempest-AttachVolumeNegativeTest-560525472</nova:project>
Nov 30 11:33:13 user nova-compute[75020]:       </nova:owner>
Nov 30 11:33:13 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:33:13 user nova-compute[75020]:       <nova:ports>
Nov 30 11:33:13 user nova-compute[75020]:         <nova:port uuid="7035cee4-9a11-47f4-9b8e-2ee775acd580">
Nov 30 11:33:13 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 11:33:13 user nova-compute[75020]:         </nova:port>
Nov 30 11:33:13 user nova-compute[75020]:       </nova:ports>
Nov 30 11:33:13 user nova-compute[75020]:     </nova:instance>
Nov 30 11:33:13 user nova-compute[75020]:   </metadata>
Nov 30 11:33:13 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:33:13 user nova-compute[75020]:     <system>
Nov 30 11:33:13 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:33:13 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:33:13 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:33:13 user nova-compute[75020]:       <entry name="serial">e2e9adff-1793-423e-90fa-2f896ab62ce7</entry>
Nov 30 11:33:13 user nova-compute[75020]:       <entry name="uuid">e2e9adff-1793-423e-90fa-2f896ab62ce7</entry>
Nov 30 11:33:13 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:33:13 user nova-compute[75020]:     </system>
Nov 30 11:33:13 user nova-compute[75020]:   </sysinfo>
Nov 30 11:33:13 user nova-compute[75020]:   <os>
Nov 30 11:33:13 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:33:13 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:33:13 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:33:13 user nova-compute[75020]:   </os>
Nov 30 11:33:13 user nova-compute[75020]:   <features>
Nov 30 11:33:13 user nova-compute[75020]:     <acpi/>
Nov 30 11:33:13 user nova-compute[75020]:     <apic/>
Nov 30 11:33:13 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:33:13 user nova-compute[75020]:   </features>
Nov 30 11:33:13 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:33:13 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:33:13 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:33:13 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:33:13 user nova-compute[75020]:   </clock>
Nov 30 11:33:13 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:33:13 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:33:13 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:33:13 user nova-compute[75020]:   </cpu>
Nov 30 11:33:13 user nova-compute[75020]:   <devices>
Nov 30 11:33:13 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:33:13 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:33:13 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk"/>
Nov 30 11:33:13 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:33:13 user nova-compute[75020]:     </disk>
Nov 30 11:33:13 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:33:13 user nova-compute[75020]:       <mac address="fa:16:3e:04:43:97"/>
Nov 30 11:33:13 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:33:13 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:33:13 user nova-compute[75020]:       <target dev="tap7035cee4-9a"/>
Nov 30 11:33:13 user nova-compute[75020]:     </interface>
Nov 30 11:33:13 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:33:13 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/console.log" append="off"/>
Nov 30 11:33:13 user nova-compute[75020]:     </serial>
Nov 30 11:33:13 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:33:13 user nova-compute[75020]:     <video>
Nov 30 11:33:13 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:33:13 user nova-compute[75020]:     </video>
Nov 30 11:33:13 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:33:13 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:33:13 user nova-compute[75020]:     </rng>
Nov 30 11:33:13 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:33:13 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:33:13 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:33:13 user nova-compute[75020]:     </memballoon>
Nov 30 11:33:13 user nova-compute[75020]:   </devices>
Nov 30 11:33:13 user nova-compute[75020]: </domain>
Nov 30 11:33:13 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1791802490',display_name='tempest-AttachVolumeNegativeTest-server-1791802490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1791802490',id=49,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw5Rg3QMHoaEaErFjIpkqB7hr+MdPDWtmlrO2nzNtf4a5Pg3Qpb5n/3b1fPHDF8MT4tQIu+caZN8vSYTOzxmjr8kpsWz6A32AmAbpJU0bGmPjFqCF5Kh3pGV+0D7nAA7Q==',key_name='tempest-keypair-1738053290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-7p402wav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=e2e9adff-1793-423e-90fa-2f896ab62ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:43:97,bridge_name='br-int',has_traffic_filtering=True,id=7035cee4-9a11-47f4-9b8e-2ee775acd580,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7035cee4-9a') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG os_vif [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:43:97,bridge_name='br-int',has_traffic_filtering=True,id=7035cee4-9a11-47f4-9b8e-2ee775acd580,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7035cee4-9a') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '755d7526-bb39-58a5-887b-56eeb4fcd9f1', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7035cee4-9a, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7035cee4-9a, col_values=(('qos', UUID('dd834806-aa8f-4d70-86e1-14f0a0010ea6')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7035cee4-9a, col_values=(('external_ids', {'iface-id': '7035cee4-9a11-47f4-9b8e-2ee775acd580', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:43:97', 'vm-uuid': 'e2e9adff-1793-423e-90fa-2f896ab62ce7'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:13 user nova-compute[75020]: INFO os_vif [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:43:97,bridge_name='br-int',has_traffic_filtering=True,id=7035cee4-9a11-47f4-9b8e-2ee775acd580,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7035cee4-9a')
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No VIF found with MAC fa:16:3e:04:43:97, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:33:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-9f0fa17a-bbc3-43c9-9f6f-ab1221744c20 req-24ae6c6c-6175-4efe-b54b-ff10097789b7 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updated VIF entry in instance network info cache for port 7035cee4-9a11-47f4-9b8e-2ee775acd580. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:33:14 user nova-compute[75020]: DEBUG nova.network.neutron [req-9f0fa17a-bbc3-43c9-9f6f-ab1221744c20 req-24ae6c6c-6175-4efe-b54b-ff10097789b7 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updating instance_info_cache with network_info: [{"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:33:14 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-9f0fa17a-bbc3-43c9-9f6f-ab1221744c20 req-24ae6c6c-6175-4efe-b54b-ff10097789b7 service nova] Releasing lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf78ee78-1029-4790-8e03-56eb29b1e88c req-840c3d66-5d9f-455b-b636-2a2212c929f8 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received event network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf78ee78-1029-4790-8e03-56eb29b1e88c req-840c3d66-5d9f-455b-b636-2a2212c929f8 service nova] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf78ee78-1029-4790-8e03-56eb29b1e88c req-840c3d66-5d9f-455b-b636-2a2212c929f8 service nova] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf78ee78-1029-4790-8e03-56eb29b1e88c req-840c3d66-5d9f-455b-b636-2a2212c929f8 service nova] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf78ee78-1029-4790-8e03-56eb29b1e88c req-840c3d66-5d9f-455b-b636-2a2212c929f8 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] No waiting events found dispatching network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:33:15 user nova-compute[75020]: WARNING nova.compute.manager [req-cf78ee78-1029-4790-8e03-56eb29b1e88c req-840c3d66-5d9f-455b-b636-2a2212c929f8 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received unexpected event network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 for instance with vm_state building and task_state spawning.
Nov 30 11:33:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:33:17 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Instance spawned successfully.
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:33:17 user nova-compute[75020]: INFO nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:33:17 user nova-compute[75020]: INFO nova.compute.manager [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Took 5.75 seconds to build instance.
Nov 30 11:33:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0676c8ab-c143-4a4b-892a-bb52b205bc9f tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.891s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-f4738065-3556-455e-af09-66f55843cd39 req-d1b4cd56-53cb-4ffe-8d8c-5742d12f5823 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received event network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f4738065-3556-455e-af09-66f55843cd39 req-d1b4cd56-53cb-4ffe-8d8c-5742d12f5823 service nova] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f4738065-3556-455e-af09-66f55843cd39 req-d1b4cd56-53cb-4ffe-8d8c-5742d12f5823 service nova] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f4738065-3556-455e-af09-66f55843cd39 req-d1b4cd56-53cb-4ffe-8d8c-5742d12f5823 service nova] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:17 user nova-compute[75020]: DEBUG nova.compute.manager [req-f4738065-3556-455e-af09-66f55843cd39 req-d1b4cd56-53cb-4ffe-8d8c-5742d12f5823 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] No waiting events found dispatching network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:33:17 user nova-compute[75020]: WARNING nova.compute.manager [req-f4738065-3556-455e-af09-66f55843cd39 req-d1b4cd56-53cb-4ffe-8d8c-5742d12f5823 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received unexpected event network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 for instance with vm_state active and task_state None.
Nov 30 11:33:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updating instance_info_cache with network_info: [{"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:33:21 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:33:22 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:33:22 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:33:22 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9141MB free_disk=25.189849853515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e2e9adff-1793-423e-90fa-2f896ab62ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:33:22 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:33:23 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:33:23 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:33:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:33:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:33:24 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:33:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:33:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:34:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:34:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:34:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updating instance_info_cache with network_info: [{"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:34:22 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:34:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:34:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:34:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:34:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:34:24 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:34:24 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:34:24 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9042MB free_disk=25.16143798828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:34:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e2e9adff-1793-423e-90fa-2f896ab62ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:34:25 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:34:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:34:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:34:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:48 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:34:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:34:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:34:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:34:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:34:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:34:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:34:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:34:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:34:59 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:34:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:34:59 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:35:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdea243d-46c5-4cec-8fa4-72d98254bc8f req-9f2b8829-f050-405c-b04f-ad5f12a71fa9 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received event network-changed-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:35:02 user nova-compute[75020]: DEBUG nova.compute.manager [req-fdea243d-46c5-4cec-8fa4-72d98254bc8f req-9f2b8829-f050-405c-b04f-ad5f12a71fa9 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Refreshing instance network info cache due to event network-changed-7035cee4-9a11-47f4-9b8e-2ee775acd580. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:35:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdea243d-46c5-4cec-8fa4-72d98254bc8f req-9f2b8829-f050-405c-b04f-ad5f12a71fa9 service nova] Acquiring lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:35:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdea243d-46c5-4cec-8fa4-72d98254bc8f req-9f2b8829-f050-405c-b04f-ad5f12a71fa9 service nova] Acquired lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:35:02 user nova-compute[75020]: DEBUG nova.network.neutron [req-fdea243d-46c5-4cec-8fa4-72d98254bc8f req-9f2b8829-f050-405c-b04f-ad5f12a71fa9 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Refreshing network info cache for port 7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:35:02 user nova-compute[75020]: DEBUG nova.network.neutron [req-fdea243d-46c5-4cec-8fa4-72d98254bc8f req-9f2b8829-f050-405c-b04f-ad5f12a71fa9 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updated VIF entry in instance network info cache for port 7035cee4-9a11-47f4-9b8e-2ee775acd580. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:35:02 user nova-compute[75020]: DEBUG nova.network.neutron [req-fdea243d-46c5-4cec-8fa4-72d98254bc8f req-9f2b8829-f050-405c-b04f-ad5f12a71fa9 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updating instance_info_cache with network_info: [{"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:35:02 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fdea243d-46c5-4cec-8fa4-72d98254bc8f req-9f2b8829-f050-405c-b04f-ad5f12a71fa9 service nova] Releasing lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:35:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:35:05 user nova-compute[75020]: INFO nova.compute.manager [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Attaching volume 80b538a5-2761-479f-8f29-091d5f07d3af to /dev/vdb
Nov 30 11:35:05 user nova-compute[75020]: DEBUG os_brick.utils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[67460047-996d-4ba1-8a3b-0548f78fc852]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0991c862-8722-405d-ada7-7a61e8af70ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa7b6e-4264-4083-a417-768eb4b999e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63262ca-c2bb-4844-a8f4-e689960b1fc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:35:05 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:35:05 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d864fb12-4172-4db2-b2f6-7a2af03f9fca]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG os_brick.utils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:35:05 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updating existing volume attachment record: a8acbf13-700d-4481-9522-8ef339ad0ce3 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:35:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:16 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:35:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvJMiPLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:35:16 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:35:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:35:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:35:16 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:35:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:35:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:35:16 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:35:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:16 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a245872-28a9-4374-87a1-9ac84e9a879e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:16 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:35:16 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:16 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c98858-35b1-41df-b514-7f4bcbda593c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af] added
Nov 30 11:35:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17bee00-f58a-4d31-a4ae-d2dea9421e77]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b700859-ac5f-4de3-8c5b-6af3cb518256]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvJMiPLH {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvJMiPLH" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da31d9-0ed4-48b2-ac92-39c6446954f4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvJMiPLH'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[92728dc2-f9ca-4308-bfe6-76c319a938d0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[336201a8-68e7-4f2e-8447-043d20149c73]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:35:17 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:35:17 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:35:17 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:35:17 user nova-compute[75020]: 
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a79912b-8125-454c-ac5d-b43e3f520587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af, portal: 172.16.0.220,3260]
Nov 30 11:35:17 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af, portal: 172.16.0.220,3260] successful.
Nov 30 11:35:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[606012a1-09fc-491b-8c98-9235106052c7]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[930a63ad-be67-4616-b44f-0ec0dd310be9]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af (non-flash)
Nov 30 11:35:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af (non-flash)
Nov 30 11:35:17 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[16846260-5a37-46ff-813d-467480440c85]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:35:17 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvJMiPLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23463376431633132', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463376431633132', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:35:18 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:35:18 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:35:18 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:35:18 user nova-compute[75020]:   <serial>80b538a5-2761-479f-8f29-091d5f07d3af</serial>
Nov 30 11:35:18 user nova-compute[75020]: </disk>
Nov 30 11:35:18 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] No VIF found with MAC fa:16:3e:04:43:97, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f3e3e97a-21c6-4c48-9566-2d1c1b1fa0cc tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.518s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:35:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:35:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:35:19 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:35:19 user nova-compute[75020]: INFO nova.compute.manager [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Detaching volume 80b538a5-2761-479f-8f29-091d5f07d3af
Nov 30 11:35:19 user nova-compute[75020]: INFO nova.virt.block_device [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Attempting to driver detach volume 80b538a5-2761-479f-8f29-091d5f07d3af from mountpoint /dev/vdb
Nov 30 11:35:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Attempting to detach device vdb from instance e2e9adff-1793-423e-90fa-2f896ab62ce7 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:35:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:35:19 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:35:19 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:35:19 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:35:19 user nova-compute[75020]:   <serial>80b538a5-2761-479f-8f29-091d5f07d3af</serial>
Nov 30 11:35:19 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:35:19 user nova-compute[75020]: </disk>
Nov 30 11:35:19 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:35:19 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully detached device vdb from instance e2e9adff-1793-423e-90fa-2f896ab62ce7 from the persistent domain config.
Nov 30 11:35:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2e9adff-1793-423e-90fa-2f896ab62ce7 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:35:19 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:35:19 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:35:19 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:35:19 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:35:19 user nova-compute[75020]:   <serial>80b538a5-2761-479f-8f29-091d5f07d3af</serial>
Nov 30 11:35:19 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:35:19 user nova-compute[75020]: </disk>
Nov 30 11:35:19 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:35:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updating instance_info_cache with network_info: [{"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-e2e9adff-1793-423e-90fa-2f896ab62ce7" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:35:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:24 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:35:24 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:35:24 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=25.16046905517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance e2e9adff-1793-423e-90fa-2f896ab62ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:35:24 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:35:25 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:25 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:35:26 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:35:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:35:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2e9adff-1793-423e-90fa-2f896ab62ce7 is timed out.
Nov 30 11:35:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully detached device vdb from instance e2e9adff-1793-423e-90fa-2f896ab62ce7 from the live domain config.
Nov 30 11:35:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvJMiPLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:35:40 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af48075-a552-41a1-8529-f12ca7333623]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:35:40 user nova-compute[75020]: No targets found.
Nov 30 11:35:40 user nova-compute[75020]: iSNS:
Nov 30 11:35:40 user nova-compute[75020]: No targets found.
Nov 30 11:35:40 user nova-compute[75020]: STATIC:
Nov 30 11:35:40 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af
Nov 30 11:35:40 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:35:40 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:35:40 user nova-compute[75020]: FIRMWARE:
Nov 30 11:35:40 user nova-compute[75020]: No targets found.
Nov 30 11:35:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:35:40 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:35:40 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f616c2-3ffc-4c05-9e4c-391f9454ddc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc433e7-b07a-42ef-95c5-510e84666db7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af (non-flash)
Nov 30 11:35:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af (non-flash)
Nov 30 11:35:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88696680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e4fae8-86dd-492b-838b-a01d1a30daf7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[536d6ca0-5ae2-44be-b17d-b1ac82b18380]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[980dfe77-25b2-4b73-acb3-f1cb4c96cdf2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[92555664-0c61-49d3-bac5-75d97847a9d6]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9949e3e-93ef-4ddc-a84d-7116b802eb80]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5aa584-4707-4fda-b5f3-7a01473bc47e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af, portal: 172.16.0.220,3260]
Nov 30 11:35:40 user nova-compute[75020]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af, portal: 172.16.0.220,3260] successful.
Nov 30 11:35:40 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b538a5-2761-479f-8f29-091d5f07d3af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaafbb0-ec3d-4acb-b752-0f351c258cfe]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] <== disconnect_volume: return (294ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:35:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:35:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'flavor' on Instance uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:35:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-5752d290-e788-4d85-ad6b-4ecad47dc8c9 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.688s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:35:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:35:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:35:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:36:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:36:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:36:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:10 user nova-compute[75020]: INFO nova.compute.manager [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Terminating instance
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.compute.manager [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-59ec9197-615d-41a4-8944-223649b5a76b req-49f862b1-02ea-40a0-bffd-8b1689207fcd service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received event network-vif-unplugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-59ec9197-615d-41a4-8944-223649b5a76b req-49f862b1-02ea-40a0-bffd-8b1689207fcd service nova] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-59ec9197-615d-41a4-8944-223649b5a76b req-49f862b1-02ea-40a0-bffd-8b1689207fcd service nova] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-59ec9197-615d-41a4-8944-223649b5a76b req-49f862b1-02ea-40a0-bffd-8b1689207fcd service nova] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-59ec9197-615d-41a4-8944-223649b5a76b req-49f862b1-02ea-40a0-bffd-8b1689207fcd service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] No waiting events found dispatching network-vif-unplugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.compute.manager [req-59ec9197-615d-41a4-8944-223649b5a76b req-49f862b1-02ea-40a0-bffd-8b1689207fcd service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received event network-vif-unplugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Instance destroyed successfully.
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.objects.instance [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lazy-loading 'resources' on Instance uuid e2e9adff-1793-423e-90fa-2f896ab62ce7 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1791802490',display_name='tempest-AttachVolumeNegativeTest-server-1791802490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1791802490',id=49,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw5Rg3QMHoaEaErFjIpkqB7hr+MdPDWtmlrO2nzNtf4a5Pg3Qpb5n/3b1fPHDF8MT4tQIu+caZN8vSYTOzxmjr8kpsWz6A32AmAbpJU0bGmPjFqCF5Kh3pGV+0D7nAA7Q==',key_name='tempest-keypair-1738053290',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:33:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fb663b4ea574c5aaab1acc6f9d7c3a2',ramdisk_id='',reservation_id='r-7p402wav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-560525472',owner_user_name='tempest-AttachVolumeNegativeTest-560525472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80403fda7f794fc79a9b7fdfb3297c72',uuid=e2e9adff-1793-423e-90fa-2f896ab62ce7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converting VIF {"id": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "address": "fa:16:3e:04:43:97", "network": {"id": "3529af07-ae8c-4aa7-9abe-31b428e513f2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1110544291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb663b4ea574c5aaab1acc6f9d7c3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7035cee4-9a", "ovs_interfaceid": "7035cee4-9a11-47f4-9b8e-2ee775acd580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:43:97,bridge_name='br-int',has_traffic_filtering=True,id=7035cee4-9a11-47f4-9b8e-2ee775acd580,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7035cee4-9a') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG os_vif [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:43:97,bridge_name='br-int',has_traffic_filtering=True,id=7035cee4-9a11-47f4-9b8e-2ee775acd580,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7035cee4-9a') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7035cee4-9a, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd834806-aa8f-4d70-86e1-14f0a0010ea6) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:36:10 user nova-compute[75020]: INFO os_vif [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:43:97,bridge_name='br-int',has_traffic_filtering=True,id=7035cee4-9a11-47f4-9b8e-2ee775acd580,network=Network(3529af07-ae8c-4aa7-9abe-31b428e513f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7035cee4-9a')
Nov 30 11:36:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Deleting instance files /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7_del
Nov 30 11:36:10 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Deletion of /opt/stack/data/nova/instances/e2e9adff-1793-423e-90fa-2f896ab62ce7_del complete
Nov 30 11:36:10 user nova-compute[75020]: INFO nova.compute.manager [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 30 11:36:10 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:36:10 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:36:11 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:36:11 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Took 0.69 seconds to deallocate network for instance.
Nov 30 11:36:11 user nova-compute[75020]: DEBUG nova.compute.manager [req-3e2d6824-9cf4-4630-84d1-27164a8281e3 req-da7e28cc-c7b1-48cd-b437-8c6f351372b9 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received event network-vif-deleted-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:36:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:36:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:36:11 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:36:11 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:36:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:36:11 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Deleted allocations for instance e2e9adff-1793-423e-90fa-2f896ab62ce7
Nov 30 11:36:11 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-855517ac-afe8-442d-b9b5-19a0421eec05 tempest-AttachVolumeNegativeTest-560525472 tempest-AttachVolumeNegativeTest-560525472-project-member] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.891s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:36:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb014bb0-6db6-4a43-9f16-9359557c5837 req-f1cc7805-f336-4d89-80b6-f017421f7152 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received event network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:36:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb014bb0-6db6-4a43-9f16-9359557c5837 req-f1cc7805-f336-4d89-80b6-f017421f7152 service nova] Acquiring lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:36:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb014bb0-6db6-4a43-9f16-9359557c5837 req-f1cc7805-f336-4d89-80b6-f017421f7152 service nova] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:36:12 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-eb014bb0-6db6-4a43-9f16-9359557c5837 req-f1cc7805-f336-4d89-80b6-f017421f7152 service nova] Lock "e2e9adff-1793-423e-90fa-2f896ab62ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:36:12 user nova-compute[75020]: DEBUG nova.compute.manager [req-eb014bb0-6db6-4a43-9f16-9359557c5837 req-f1cc7805-f336-4d89-80b6-f017421f7152 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] No waiting events found dispatching network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:36:12 user nova-compute[75020]: WARNING nova.compute.manager [req-eb014bb0-6db6-4a43-9f16-9359557c5837 req-f1cc7805-f336-4d89-80b6-f017421f7152 service nova] [instance: e2e9adff-1793-423e-90fa-2f896ab62ce7] Received unexpected event network-vif-plugged-7035cee4-9a11-47f4-9b8e-2ee775acd580 for instance with vm_state deleted and task_state None.
Nov 30 11:36:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:22 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:25 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:25 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:36:25 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:36:25 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:36:25 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:36:26 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:36:26 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:36:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9179MB free_disk=25.187698364257812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:36:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:36:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:28 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:36:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:36:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:36:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:36:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:36:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:36:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:36:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:36:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:36:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:37:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:37:11 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:23 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:37:26 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:37:26 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:37:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9175MB free_disk=25.186359405517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:37:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:37:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:27 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:37:27 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:37:27 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:37:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:37:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:37:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:37:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:37:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:37:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:37:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:37:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:37:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:38:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:23 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:38:26 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:38:26 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:38:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9198MB free_disk=25.176605224609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:38:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:29 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:38:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:38:29 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:38:29 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:38:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:33 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:38:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:33 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:38:33 user nova-compute[75020]: INFO nova.compute.claims [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Claim successful on node user
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:38:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.policy [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dbed147b4e34ee397e9eb565c5b970e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62125bd386d84f3ea13f872ba8a77a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:38:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Creating image(s)
Nov 30 11:38:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "/opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "/opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "c453fc640f9db015a940ca59274a7eda5e37a5ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "c453fc640f9db015a940ca59274a7eda5e37a5ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Successfully created port: 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee.part --force-share --output=json" returned: 0 in 0.274s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG nova.virt.images [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] 5b98b52b-8414-4c1a-8bc2-fc77d6af983a was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee.part /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee.part /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee.converted" returned: 0 in 0.344s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "c453fc640f9db015a940ca59274a7eda5e37a5ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.411s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:35 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Successfully updated port: 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "c453fc640f9db015a940ca59274a7eda5e37a5ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "c453fc640f9db015a940ca59274a7eda5e37a5ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-70f4e783-6829-48f2-8c75-105aebdb5c1d req-5d534936-c174-4b22-90f3-3dbadd84c6e9 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-70f4e783-6829-48f2-8c75-105aebdb5c1d req-5d534936-c174-4b22-90f3-3dbadd84c6e9 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing instance network info cache due to event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-70f4e783-6829-48f2-8c75-105aebdb5c1d req-5d534936-c174-4b22-90f3-3dbadd84c6e9 service nova] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee,backing_fmt=raw /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee,backing_fmt=raw /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk 1073741824" returned: 0 in 0.061s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "c453fc640f9db015a940ca59274a7eda5e37a5ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Instance network_info: |[{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-70f4e783-6829-48f2-8c75-105aebdb5c1d req-5d534936-c174-4b22-90f3-3dbadd84c6e9 service nova] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.neutron [req-70f4e783-6829-48f2-8c75-105aebdb5c1d req-5d534936-c174-4b22-90f3-3dbadd84c6e9 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Cannot resize image /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Ensure instance console log exists: /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Start _get_guest_xml network_info=[{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T11:38:31Z,direct_url=<?>,disk_format='qcow2',id=5b98b52b-8414-4c1a-8bc2-fc77d6af983a,min_disk=0,min_ram=0,name='tempest-scenario-img--1554017342',owner='62125bd386d84f3ea13f872ba8a77a47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T11:38:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': '5b98b52b-8414-4c1a-8bc2-fc77d6af983a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:38:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:38:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T11:38:31Z,direct_url=<?>,disk_format='qcow2',id=5b98b52b-8414-4c1a-8bc2-fc77d6af983a,min_disk=0,min_ram=0,name='tempest-scenario-img--1554017342',owner='62125bd386d84f3ea13f872ba8a77a47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T11:38:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1531415780',display_name='tempest-TestMinimumBasicScenario-server-1531415780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1531415780',id=50,image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuTAMwSmLDjPzspNaOaFzxDdK0v2fm3Q6MK2vIJ/MKrqWaBrOhbW/04cmfqLsDQ+mG5CyGuRW/lGPgGgk1KduqzNb6BBPQygDrJQEPRkinEEtSt/s99ESZBqRXAkSx/Sw==',key_name='tempest-TestMinimumBasicScenario-1716386495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-0xznzbi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:38:34Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=7b8eaadd-e3fb-443a-9246-e580ab61eef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.objects.instance [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:38:36 user nova-compute[75020]:   <uuid>7b8eaadd-e3fb-443a-9246-e580ab61eef3</uuid>
Nov 30 11:38:36 user nova-compute[75020]:   <name>instance-00000032</name>
Nov 30 11:38:36 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:38:36 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:38:36 user nova-compute[75020]:   <metadata>
Nov 30 11:38:36 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:38:36 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:38:36 user nova-compute[75020]:       <nova:name>tempest-TestMinimumBasicScenario-server-1531415780</nova:name>
Nov 30 11:38:36 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:38:36</nova:creationTime>
Nov 30 11:38:36 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:38:36 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:38:36 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:38:36 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:38:36 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:38:36 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:38:36 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:38:36 user nova-compute[75020]:       <nova:owner>
Nov 30 11:38:36 user nova-compute[75020]:         <nova:user uuid="1dbed147b4e34ee397e9eb565c5b970e">tempest-TestMinimumBasicScenario-1701357472-project-member</nova:user>
Nov 30 11:38:36 user nova-compute[75020]:         <nova:project uuid="62125bd386d84f3ea13f872ba8a77a47">tempest-TestMinimumBasicScenario-1701357472</nova:project>
Nov 30 11:38:36 user nova-compute[75020]:       </nova:owner>
Nov 30 11:38:36 user nova-compute[75020]:       <nova:root type="image" uuid="5b98b52b-8414-4c1a-8bc2-fc77d6af983a"/>
Nov 30 11:38:36 user nova-compute[75020]:       <nova:ports>
Nov 30 11:38:36 user nova-compute[75020]:         <nova:port uuid="7e29ad13-80dd-4c70-a4b9-b7f17012fc3e">
Nov 30 11:38:36 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 11:38:36 user nova-compute[75020]:         </nova:port>
Nov 30 11:38:36 user nova-compute[75020]:       </nova:ports>
Nov 30 11:38:36 user nova-compute[75020]:     </nova:instance>
Nov 30 11:38:36 user nova-compute[75020]:   </metadata>
Nov 30 11:38:36 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:38:36 user nova-compute[75020]:     <system>
Nov 30 11:38:36 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:38:36 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:38:36 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:38:36 user nova-compute[75020]:       <entry name="serial">7b8eaadd-e3fb-443a-9246-e580ab61eef3</entry>
Nov 30 11:38:36 user nova-compute[75020]:       <entry name="uuid">7b8eaadd-e3fb-443a-9246-e580ab61eef3</entry>
Nov 30 11:38:36 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:38:36 user nova-compute[75020]:     </system>
Nov 30 11:38:36 user nova-compute[75020]:   </sysinfo>
Nov 30 11:38:36 user nova-compute[75020]:   <os>
Nov 30 11:38:36 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:38:36 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:38:36 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:38:36 user nova-compute[75020]:   </os>
Nov 30 11:38:36 user nova-compute[75020]:   <features>
Nov 30 11:38:36 user nova-compute[75020]:     <acpi/>
Nov 30 11:38:36 user nova-compute[75020]:     <apic/>
Nov 30 11:38:36 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:38:36 user nova-compute[75020]:   </features>
Nov 30 11:38:36 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:38:36 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:38:36 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:38:36 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:38:36 user nova-compute[75020]:   </clock>
Nov 30 11:38:36 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:38:36 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:38:36 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:38:36 user nova-compute[75020]:   </cpu>
Nov 30 11:38:36 user nova-compute[75020]:   <devices>
Nov 30 11:38:36 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:38:36 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:38:36 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk"/>
Nov 30 11:38:36 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:38:36 user nova-compute[75020]:     </disk>
Nov 30 11:38:36 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:38:36 user nova-compute[75020]:       <mac address="fa:16:3e:73:bd:c3"/>
Nov 30 11:38:36 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:38:36 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:38:36 user nova-compute[75020]:       <target dev="tap7e29ad13-80"/>
Nov 30 11:38:36 user nova-compute[75020]:     </interface>
Nov 30 11:38:36 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:38:36 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/console.log" append="off"/>
Nov 30 11:38:36 user nova-compute[75020]:     </serial>
Nov 30 11:38:36 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:38:36 user nova-compute[75020]:     <video>
Nov 30 11:38:36 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:38:36 user nova-compute[75020]:     </video>
Nov 30 11:38:36 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:38:36 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:38:36 user nova-compute[75020]:     </rng>
Nov 30 11:38:36 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:38:36 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:38:36 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:38:36 user nova-compute[75020]:     </memballoon>
Nov 30 11:38:36 user nova-compute[75020]:   </devices>
Nov 30 11:38:36 user nova-compute[75020]: </domain>
Nov 30 11:38:36 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1531415780',display_name='tempest-TestMinimumBasicScenario-server-1531415780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1531415780',id=50,image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuTAMwSmLDjPzspNaOaFzxDdK0v2fm3Q6MK2vIJ/MKrqWaBrOhbW/04cmfqLsDQ+mG5CyGuRW/lGPgGgk1KduqzNb6BBPQygDrJQEPRkinEEtSt/s99ESZBqRXAkSx/Sw==',key_name='tempest-TestMinimumBasicScenario-1716386495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-0xznzbi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:38:34Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=7b8eaadd-e3fb-443a-9246-e580ab61eef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG os_vif [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c225eece-68a8-51bb-a8e6-9365dfec69d8', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e29ad13-80, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e29ad13-80, col_values=(('qos', UUID('6277f2da-3547-47a0-9962-5d414f2b393b')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e29ad13-80, col_values=(('external_ids', {'iface-id': '7e29ad13-80dd-4c70-a4b9-b7f17012fc3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:bd:c3', 'vm-uuid': '7b8eaadd-e3fb-443a-9246-e580ab61eef3'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:36 user nova-compute[75020]: INFO os_vif [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80')
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No VIF found with MAC fa:16:3e:73:bd:c3, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.neutron [req-70f4e783-6829-48f2-8c75-105aebdb5c1d req-5d534936-c174-4b22-90f3-3dbadd84c6e9 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated VIF entry in instance network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG nova.network.neutron [req-70f4e783-6829-48f2-8c75-105aebdb5c1d req-5d534936-c174-4b22-90f3-3dbadd84c6e9 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:38:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-70f4e783-6829-48f2-8c75-105aebdb5c1d req-5d534936-c174-4b22-90f3-3dbadd84c6e9 service nova] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-da9372f9-8a2a-47f1-a973-451bdbc68495 req-cf1e763c-41ec-467e-8c8b-caa8a8888d4e service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-da9372f9-8a2a-47f1-a973-451bdbc68495 req-cf1e763c-41ec-467e-8c8b-caa8a8888d4e service nova] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-da9372f9-8a2a-47f1-a973-451bdbc68495 req-cf1e763c-41ec-467e-8c8b-caa8a8888d4e service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-da9372f9-8a2a-47f1-a973-451bdbc68495 req-cf1e763c-41ec-467e-8c8b-caa8a8888d4e service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-da9372f9-8a2a-47f1-a973-451bdbc68495 req-cf1e763c-41ec-467e-8c8b-caa8a8888d4e service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] No waiting events found dispatching network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:38:38 user nova-compute[75020]: WARNING nova.compute.manager [req-da9372f9-8a2a-47f1-a973-451bdbc68495 req-cf1e763c-41ec-467e-8c8b-caa8a8888d4e service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received unexpected event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e for instance with vm_state building and task_state spawning.
Nov 30 11:38:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:38:40 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Instance spawned successfully.
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-cadea44b-8ecc-40ea-8ba5-0f191eda8fc2 req-0c8069f1-4dbc-4f8e-818a-0149cbc54a67 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cadea44b-8ecc-40ea-8ba5-0f191eda8fc2 req-0c8069f1-4dbc-4f8e-818a-0149cbc54a67 service nova] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cadea44b-8ecc-40ea-8ba5-0f191eda8fc2 req-0c8069f1-4dbc-4f8e-818a-0149cbc54a67 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cadea44b-8ecc-40ea-8ba5-0f191eda8fc2 req-0c8069f1-4dbc-4f8e-818a-0149cbc54a67 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.compute.manager [req-cadea44b-8ecc-40ea-8ba5-0f191eda8fc2 req-0c8069f1-4dbc-4f8e-818a-0149cbc54a67 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] No waiting events found dispatching network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:38:40 user nova-compute[75020]: WARNING nova.compute.manager [req-cadea44b-8ecc-40ea-8ba5-0f191eda8fc2 req-0c8069f1-4dbc-4f8e-818a-0149cbc54a67 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received unexpected event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e for instance with vm_state building and task_state spawning.
Nov 30 11:38:40 user nova-compute[75020]: INFO nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 30 11:38:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:38:40 user nova-compute[75020]: INFO nova.compute.manager [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Took 6.64 seconds to build instance.
Nov 30 11:38:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-fa2de621-5b09-43a4-a643-c7def3428e6f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.747s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:38:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:53 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:38:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:38:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:19 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:39:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:39:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:39:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:26 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:39:26 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:39:26 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9038MB free_disk=25.086166381835938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:39:26 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:27 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:39:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:39:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:39:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:39:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:39:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:39:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:39:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:39:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:39:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:39:57 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:40:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:40:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:13 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:40:13 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:40:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:40:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:16 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:25 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:40:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'flavor' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:40:27 user nova-compute[75020]: INFO nova.compute.manager [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Attaching volume a332f9df-e0b1-4d11-a746-08b659b49144 to /dev/vdb
Nov 30 11:40:27 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:40:27 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:40:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9052MB free_disk=25.085426330566406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG os_brick.utils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb94e954-24c8-48d1-84e6-48a760a93f7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca21a3e-6dc3-41fd-bc7f-dbfdbfb5ba56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8e19e6-28ae-41df-babf-e3e9a6b09c1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae67cee-5ca4-4344-bd41-7073ae3b83e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:40:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:40:28 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:40:28 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[260f3fa0-16d4-4f1a-8b7b-27f6f9889c21]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG os_brick.utils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating existing volume attachment record: 9a407302-e466-4a9e-a4e6-081046a6991a {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:40:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:40:30 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:40:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouQlxAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:40:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:40:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:40:36 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bae689-b660-4e86-8c6b-4b73a814932e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:40:36 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe13c55-9f26-418e-a873-8b253c5d9d23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144] added
Nov 30 11:40:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[78739d61-a258-40c7-a365-856c80cf2dd8]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cf36ad-a827-42cc-8ed0-2d751c4501e2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wouQlxAY {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wouQlxAY" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bca66ec-2420-410b-b01f-d5faddb89f33]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wouQlxAY'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b0fb3c-73e0-4d44-99a7-e2c629919955]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4081023-bc0f-47b3-98a3-c0131dea4a4c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:40:36 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:40:36 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:40:36 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:40:36 user nova-compute[75020]: 
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ca0e01-31a7-4fb9-bcf6-23229b773ac2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260]
Nov 30 11:40:36 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260] successful.
Nov 30 11:40:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5101165-83a6-4a8b-9ced-8f05f73da138]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[592449bf-9ced-4bc4-a2ca-246cb83f06fe]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)
Nov 30 11:40:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)
Nov 30 11:40:36 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e71f30-496e-4800-a0e4-88e771a36986]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouQlxAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:40:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:40:37 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26363326532623635', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:40:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363326532623635', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:40:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'flavor' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:40:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:40:37 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:40:37 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:40:37 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:40:37 user nova-compute[75020]:   <serial>a332f9df-e0b1-4d11-a746-08b659b49144</serial>
Nov 30 11:40:37 user nova-compute[75020]: </disk>
Nov 30 11:40:37 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:40:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:40:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:40:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No VIF found with MAC fa:16:3e:73:bd:c3, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:40:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c9127e93-d0c0-4d9e-914d-7ab706ee39d3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.721s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:40:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:40:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:40:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-386fd179-f598-4da7-a6a9-7fed96a29c1f req-99993d4c-1056-43b0-aea9-c8d2ca815a09 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:40:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-386fd179-f598-4da7-a6a9-7fed96a29c1f req-99993d4c-1056-43b0-aea9-c8d2ca815a09 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing instance network info cache due to event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:40:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-386fd179-f598-4da7-a6a9-7fed96a29c1f req-99993d4c-1056-43b0-aea9-c8d2ca815a09 service nova] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:40:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-386fd179-f598-4da7-a6a9-7fed96a29c1f req-99993d4c-1056-43b0-aea9-c8d2ca815a09 service nova] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:40:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-386fd179-f598-4da7-a6a9-7fed96a29c1f req-99993d4c-1056-43b0-aea9-c8d2ca815a09 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:40:46 user nova-compute[75020]: DEBUG nova.network.neutron [req-386fd179-f598-4da7-a6a9-7fed96a29c1f req-99993d4c-1056-43b0-aea9-c8d2ca815a09 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated VIF entry in instance network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:40:46 user nova-compute[75020]: DEBUG nova.network.neutron [req-386fd179-f598-4da7-a6a9-7fed96a29c1f req-99993d4c-1056-43b0-aea9-c8d2ca815a09 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:40:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-386fd179-f598-4da7-a6a9-7fed96a29c1f req-99993d4c-1056-43b0-aea9-c8d2ca815a09 service nova] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:40:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-4afc3883-494b-4380-8a1a-9854643bba7c req-90f24003-d28f-4112-8cdf-e43dd4dbff2f service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:40:48 user nova-compute[75020]: DEBUG nova.compute.manager [req-4afc3883-494b-4380-8a1a-9854643bba7c req-90f24003-d28f-4112-8cdf-e43dd4dbff2f service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing instance network info cache due to event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:40:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4afc3883-494b-4380-8a1a-9854643bba7c req-90f24003-d28f-4112-8cdf-e43dd4dbff2f service nova] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:40:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4afc3883-494b-4380-8a1a-9854643bba7c req-90f24003-d28f-4112-8cdf-e43dd4dbff2f service nova] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:40:48 user nova-compute[75020]: DEBUG nova.network.neutron [req-4afc3883-494b-4380-8a1a-9854643bba7c req-90f24003-d28f-4112-8cdf-e43dd4dbff2f service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:40:48 user nova-compute[75020]: DEBUG nova.network.neutron [req-4afc3883-494b-4380-8a1a-9854643bba7c req-90f24003-d28f-4112-8cdf-e43dd4dbff2f service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated VIF entry in instance network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:40:48 user nova-compute[75020]: DEBUG nova.network.neutron [req-4afc3883-494b-4380-8a1a-9854643bba7c req-90f24003-d28f-4112-8cdf-e43dd4dbff2f service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:40:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4afc3883-494b-4380-8a1a-9854643bba7c req-90f24003-d28f-4112-8cdf-e43dd4dbff2f service nova] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:40:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:40:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:40:53 user nova-compute[75020]: INFO nova.compute.manager [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Rebooting instance
Nov 30 11:40:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:40:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:40:53 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG nova.network.neutron [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-c48cbf01-2612-432a-8071-63eed9ef083c req-5db6b7c1-c86c-4a4e-aa79-e74b0c67a887 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-unplugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c48cbf01-2612-432a-8071-63eed9ef083c req-5db6b7c1-c86c-4a4e-aa79-e74b0c67a887 service nova] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c48cbf01-2612-432a-8071-63eed9ef083c req-5db6b7c1-c86c-4a4e-aa79-e74b0c67a887 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c48cbf01-2612-432a-8071-63eed9ef083c req-5db6b7c1-c86c-4a4e-aa79-e74b0c67a887 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:40:54 user nova-compute[75020]: DEBUG nova.compute.manager [req-c48cbf01-2612-432a-8071-63eed9ef083c req-5db6b7c1-c86c-4a4e-aa79-e74b0c67a887 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] No waiting events found dispatching network-vif-unplugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:40:54 user nova-compute[75020]: WARNING nova.compute.manager [req-c48cbf01-2612-432a-8071-63eed9ef083c req-5db6b7c1-c86c-4a4e-aa79-e74b0c67a887 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received unexpected event network-vif-unplugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e for instance with vm_state active and task_state reboot_started_hard.
Nov 30 11:40:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:55 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Instance destroyed successfully.
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'resources' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1531415780',display_name='tempest-TestMinimumBasicScenario-server-1531415780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1531415780',id=50,image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuTAMwSmLDjPzspNaOaFzxDdK0v2fm3Q6MK2vIJ/MKrqWaBrOhbW/04cmfqLsDQ+mG5CyGuRW/lGPgGgk1KduqzNb6BBPQygDrJQEPRkinEEtSt/s99ESZBqRXAkSx/Sw==',key_name='tempest-TestMinimumBasicScenario-1716386495',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:38:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-0xznzbi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:40:54Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=7b8eaadd-e3fb-443a-9246-e580ab61eef3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_vif [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e29ad13-80, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6277f2da-3547-47a0-9962-5d414f2b393b) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:55 user nova-compute[75020]: INFO os_vif [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80')
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouQlxAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:40:55 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0282e4-cc85-4720-8d07-bf299708d3c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:40:55 user nova-compute[75020]: No targets found.
Nov 30 11:40:55 user nova-compute[75020]: iSNS:
Nov 30 11:40:55 user nova-compute[75020]: No targets found.
Nov 30 11:40:55 user nova-compute[75020]: STATIC:
Nov 30 11:40:55 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144
Nov 30 11:40:55 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:40:55 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:40:55 user nova-compute[75020]: FIRMWARE:
Nov 30 11:40:55 user nova-compute[75020]: No targets found.
Nov 30 11:40:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:40:55 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:40:55 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb07fd46-d74e-4cd9-a9b4-ec72156e74db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c3076-0ebb-4451-9c98-1d21e5cb79e5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)
Nov 30 11:40:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)
Nov 30 11:40:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad884f0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc28bc-7c45-409b-ab93-1f5970d2f23d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[31adeb05-219a-4cad-b272-8a161a2ae314]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6b8a96-4b93-49b6-89ab-d9f2b2293d4b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe519a-5cbb-454c-ae76-f8720be4195d]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[24adebe6-077c-40f0-8f11-88db66efc1f8]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8088a4ae-b5ec-4da3-8ad8-55eb002f7565]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260]
Nov 30 11:40:55 user nova-compute[75020]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260] successful.
Nov 30 11:40:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fee0d7-fe13-4577-b122-d719e29f474c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] <== disconnect_volume: return (284ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Start _get_guest_xml network_info=[{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5b98b52b-8414-4c1a-8bc2-fc77d6af983a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': '5b98b52b-8414-4c1a-8bc2-fc77d6af983a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '9a407302-e466-4a9e-a4e6-081046a6991a', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouQlxAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7b8eaadd-e3fb-443a-9246-e580ab61eef3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a332f9df-e0b1-4d11-a746-08b659b49144', 'serial': 'a332f9df-e0b1-4d11-a746-08b659b49144'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:40:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:40:55 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5b98b52b-8414-4c1a-8bc2-fc77d6af983a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.objects.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Object Instance<7b8eaadd-e3fb-443a-9246-e580ab61eef3> lazy-loaded attributes: resources,vcpu_model {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouQlxAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:40:55 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:40:55 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:40:55 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[30457e4c-25e1-4850-ba70-47e335ba5ec9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:40:55 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f770ee-b1ea-4eb8-b74e-5c264ff44ed9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144] added
Nov 30 11:40:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[484bbf98-6f8c-41b2-a224-377095eca591]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c6cd50-1548-4e0a-9cf3-bd4330cfca25]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wouQlxAY {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wouQlxAY" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7324e1-2b9b-466c-b04d-d3e39c2a4cf4]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wouQlxAY'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6940645-fb56-4eac-a1b4-ac536d807280]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacced9b-cb50-40ea-8e47-22c52441c811]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:40:55 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:40:55 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:40:55 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:40:55 user nova-compute[75020]: 
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4447b51f-1e42-4512-bdd8-8d72aca8a842]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260]
Nov 30 11:40:55 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260] successful.
Nov 30 11:40:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b75c81-3f6b-4824-bcef-2a301211b9c1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b103da7-741e-4db9-a38a-0d22002da237]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)
Nov 30 11:40:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)
Nov 30 11:40:55 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cedb10-5f94-4384-a555-6a3f5aeb1dcb]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:40:55 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouQlxAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-fea47241-6509-4a3a-83b8-53a9a74ca2cb req-89882946-c3af-4f83-b395-026b1f8f4055 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fea47241-6509-4a3a-83b8-53a9a74ca2cb req-89882946-c3af-4f83-b395-026b1f8f4055 service nova] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fea47241-6509-4a3a-83b8-53a9a74ca2cb req-89882946-c3af-4f83-b395-026b1f8f4055 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-fea47241-6509-4a3a-83b8-53a9a74ca2cb req-89882946-c3af-4f83-b395-026b1f8f4055 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.compute.manager [req-fea47241-6509-4a3a-83b8-53a9a74ca2cb req-89882946-c3af-4f83-b395-026b1f8f4055 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] No waiting events found dispatching network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:40:56 user nova-compute[75020]: WARNING nova.compute.manager [req-fea47241-6509-4a3a-83b8-53a9a74ca2cb req-89882946-c3af-4f83-b395-026b1f8f4055 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received unexpected event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e for instance with vm_state active and task_state reboot_started_hard.
Nov 30 11:40:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26363326532623635', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363326532623635', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1531415780',display_name='tempest-TestMinimumBasicScenario-server-1531415780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1531415780',id=50,image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuTAMwSmLDjPzspNaOaFzxDdK0v2fm3Q6MK2vIJ/MKrqWaBrOhbW/04cmfqLsDQ+mG5CyGuRW/lGPgGgk1KduqzNb6BBPQygDrJQEPRkinEEtSt/s99ESZBqRXAkSx/Sw==',key_name='tempest-TestMinimumBasicScenario-1716386495',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:38:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-0xznzbi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:40:54Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=7b8eaadd-e3fb-443a-9246-e580ab61eef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.objects.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Object Instance<7b8eaadd-e3fb-443a-9246-e580ab61eef3> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:40:56 user nova-compute[75020]:   <uuid>7b8eaadd-e3fb-443a-9246-e580ab61eef3</uuid>
Nov 30 11:40:56 user nova-compute[75020]:   <name>instance-00000032</name>
Nov 30 11:40:56 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:40:56 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:40:56 user nova-compute[75020]:   <metadata>
Nov 30 11:40:56 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:40:56 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:40:56 user nova-compute[75020]:       <nova:name>tempest-TestMinimumBasicScenario-server-1531415780</nova:name>
Nov 30 11:40:56 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:40:55</nova:creationTime>
Nov 30 11:40:56 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:40:56 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:40:56 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:40:56 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:40:56 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:40:56 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:40:56 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:40:56 user nova-compute[75020]:       <nova:owner>
Nov 30 11:40:56 user nova-compute[75020]:         <nova:user uuid="1dbed147b4e34ee397e9eb565c5b970e">tempest-TestMinimumBasicScenario-1701357472-project-member</nova:user>
Nov 30 11:40:56 user nova-compute[75020]:         <nova:project uuid="62125bd386d84f3ea13f872ba8a77a47">tempest-TestMinimumBasicScenario-1701357472</nova:project>
Nov 30 11:40:56 user nova-compute[75020]:       </nova:owner>
Nov 30 11:40:56 user nova-compute[75020]:       <nova:root type="image" uuid="5b98b52b-8414-4c1a-8bc2-fc77d6af983a"/>
Nov 30 11:40:56 user nova-compute[75020]:       <nova:ports>
Nov 30 11:40:56 user nova-compute[75020]:         <nova:port uuid="7e29ad13-80dd-4c70-a4b9-b7f17012fc3e">
Nov 30 11:40:56 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 11:40:56 user nova-compute[75020]:         </nova:port>
Nov 30 11:40:56 user nova-compute[75020]:       </nova:ports>
Nov 30 11:40:56 user nova-compute[75020]:     </nova:instance>
Nov 30 11:40:56 user nova-compute[75020]:   </metadata>
Nov 30 11:40:56 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:40:56 user nova-compute[75020]:     <system>
Nov 30 11:40:56 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:40:56 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:40:56 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:40:56 user nova-compute[75020]:       <entry name="serial">7b8eaadd-e3fb-443a-9246-e580ab61eef3</entry>
Nov 30 11:40:56 user nova-compute[75020]:       <entry name="uuid">7b8eaadd-e3fb-443a-9246-e580ab61eef3</entry>
Nov 30 11:40:56 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:40:56 user nova-compute[75020]:     </system>
Nov 30 11:40:56 user nova-compute[75020]:   </sysinfo>
Nov 30 11:40:56 user nova-compute[75020]:   <os>
Nov 30 11:40:56 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:40:56 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:40:56 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:40:56 user nova-compute[75020]:   </os>
Nov 30 11:40:56 user nova-compute[75020]:   <features>
Nov 30 11:40:56 user nova-compute[75020]:     <acpi/>
Nov 30 11:40:56 user nova-compute[75020]:     <apic/>
Nov 30 11:40:56 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:40:56 user nova-compute[75020]:   </features>
Nov 30 11:40:56 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:40:56 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:40:56 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:40:56 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:40:56 user nova-compute[75020]:   </clock>
Nov 30 11:40:56 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:40:56 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:40:56 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:40:56 user nova-compute[75020]:   </cpu>
Nov 30 11:40:56 user nova-compute[75020]:   <devices>
Nov 30 11:40:56 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:40:56 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:40:56 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk"/>
Nov 30 11:40:56 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:40:56 user nova-compute[75020]:     </disk>
Nov 30 11:40:56 user nova-compute[75020]:     <disk type="block" device="disk">
Nov 30 11:40:56 user nova-compute[75020]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:40:56 user nova-compute[75020]:       <source dev="/dev/sdb"/>
Nov 30 11:40:56 user nova-compute[75020]:       <target dev="vdb" bus="virtio"/>
Nov 30 11:40:56 user nova-compute[75020]:       <serial>a332f9df-e0b1-4d11-a746-08b659b49144</serial>
Nov 30 11:40:56 user nova-compute[75020]:     </disk>
Nov 30 11:40:56 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:40:56 user nova-compute[75020]:       <mac address="fa:16:3e:73:bd:c3"/>
Nov 30 11:40:56 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:40:56 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:40:56 user nova-compute[75020]:       <target dev="tap7e29ad13-80"/>
Nov 30 11:40:56 user nova-compute[75020]:     </interface>
Nov 30 11:40:56 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:40:56 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/console.log" append="off"/>
Nov 30 11:40:56 user nova-compute[75020]:     </serial>
Nov 30 11:40:56 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:40:56 user nova-compute[75020]:     <video>
Nov 30 11:40:56 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:40:56 user nova-compute[75020]:     </video>
Nov 30 11:40:56 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:40:56 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:40:56 user nova-compute[75020]:     </rng>
Nov 30 11:40:56 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:40:56 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:40:56 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:40:56 user nova-compute[75020]:     </memballoon>
Nov 30 11:40:56 user nova-compute[75020]:   </devices>
Nov 30 11:40:56 user nova-compute[75020]: </domain>
Nov 30 11:40:56 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:56 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.objects.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Object Instance<7b8eaadd-e3fb-443a-9246-e580ab61eef3> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c453fc640f9db015a940ca59274a7eda5e37a5ee --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Cannot resize image /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.objects.instance [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'migration_context' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.objects.base [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Object Instance<7b8eaadd-e3fb-443a-9246-e580ab61eef3> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75020) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1531415780',display_name='tempest-TestMinimumBasicScenario-server-1531415780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1531415780',id=50,image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuTAMwSmLDjPzspNaOaFzxDdK0v2fm3Q6MK2vIJ/MKrqWaBrOhbW/04cmfqLsDQ+mG5CyGuRW/lGPgGgk1KduqzNb6BBPQygDrJQEPRkinEEtSt/s99ESZBqRXAkSx/Sw==',key_name='tempest-TestMinimumBasicScenario-1716386495',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:38:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-0xznzbi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:40:54Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=7b8eaadd-e3fb-443a-9246-e580ab61eef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG os_vif [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c225eece-68a8-51bb-a8e6-9365dfec69d8', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e29ad13-80, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e29ad13-80, col_values=(('qos', UUID('95eef9c1-f799-441b-b3f1-90811b998f16')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e29ad13-80, col_values=(('external_ids', {'iface-id': '7e29ad13-80dd-4c70-a4b9-b7f17012fc3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:bd:c3', 'vm-uuid': '7b8eaadd-e3fb-443a-9246-e580ab61eef3'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:40:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:57 user nova-compute[75020]: INFO os_vif [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80')
Nov 30 11:40:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-f7f6a6a0-b18b-4c75-9c47-a5afbf215380 req-17de665d-3e93-4f9a-9c6a-a112ce0e0dfc service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f7f6a6a0-b18b-4c75-9c47-a5afbf215380 req-17de665d-3e93-4f9a-9c6a-a112ce0e0dfc service nova] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f7f6a6a0-b18b-4c75-9c47-a5afbf215380 req-17de665d-3e93-4f9a-9c6a-a112ce0e0dfc service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f7f6a6a0-b18b-4c75-9c47-a5afbf215380 req-17de665d-3e93-4f9a-9c6a-a112ce0e0dfc service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG nova.compute.manager [req-f7f6a6a0-b18b-4c75-9c47-a5afbf215380 req-17de665d-3e93-4f9a-9c6a-a112ce0e0dfc service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] No waiting events found dispatching network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:40:59 user nova-compute[75020]: WARNING nova.compute.manager [req-f7f6a6a0-b18b-4c75-9c47-a5afbf215380 req-17de665d-3e93-4f9a-9c6a-a112ce0e0dfc service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received unexpected event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e for instance with vm_state active and task_state reboot_started_hard.
Nov 30 11:40:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:40:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:41:01 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Instance rebooted successfully.
Nov 30 11:41:01 user nova-compute[75020]: DEBUG nova.compute.manager [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:41:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-58d1092e-ed86-47a8-95ac-893bd51f507f req-9c19a38a-f644-45b2-b6f4-8c3b8ee00c51 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:41:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58d1092e-ed86-47a8-95ac-893bd51f507f req-9c19a38a-f644-45b2-b6f4-8c3b8ee00c51 service nova] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:41:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58d1092e-ed86-47a8-95ac-893bd51f507f req-9c19a38a-f644-45b2-b6f4-8c3b8ee00c51 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:41:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58d1092e-ed86-47a8-95ac-893bd51f507f req-9c19a38a-f644-45b2-b6f4-8c3b8ee00c51 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:41:01 user nova-compute[75020]: DEBUG nova.compute.manager [req-58d1092e-ed86-47a8-95ac-893bd51f507f req-9c19a38a-f644-45b2-b6f4-8c3b8ee00c51 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] No waiting events found dispatching network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:41:01 user nova-compute[75020]: WARNING nova.compute.manager [req-58d1092e-ed86-47a8-95ac-893bd51f507f req-9c19a38a-f644-45b2-b6f4-8c3b8ee00c51 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received unexpected event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e for instance with vm_state active and task_state reboot_started_hard.
Nov 30 11:41:01 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-bb44b4c4-b6c7-428f-af06-fc30e813d1a7 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.998s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:41:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:41:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:17 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:25 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:27 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:41:27 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:41:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.083202362060547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:41:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:41:28 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:41:28 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:41:28 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:41:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:41:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:41:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:41:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:41:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:41:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:41:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:41:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:41:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:41:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:41:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:41:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:41:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:41:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:41:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:41:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:41:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:41:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:42:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:42:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:42:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:42:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:42:27 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:42:27 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:42:27 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=25.08263397216797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:42:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:28 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:42:28 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:42:28 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:42:28 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:42:28 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:42:28 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:42:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:42:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:42:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-2ae127db-1e41-4c08-b4a5-df5c84d2f2c9 req-229a8486-ec57-4d52-9f58-3c82132a2639 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-2ae127db-1e41-4c08-b4a5-df5c84d2f2c9 req-229a8486-ec57-4d52-9f58-3c82132a2639 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing instance network info cache due to event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2ae127db-1e41-4c08-b4a5-df5c84d2f2c9 req-229a8486-ec57-4d52-9f58-3c82132a2639 service nova] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2ae127db-1e41-4c08-b4a5-df5c84d2f2c9 req-229a8486-ec57-4d52-9f58-3c82132a2639 service nova] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-2ae127db-1e41-4c08-b4a5-df5c84d2f2c9 req-229a8486-ec57-4d52-9f58-3c82132a2639 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-2ae127db-1e41-4c08-b4a5-df5c84d2f2c9 req-229a8486-ec57-4d52-9f58-3c82132a2639 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated VIF entry in instance network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-2ae127db-1e41-4c08-b4a5-df5c84d2f2c9 req-229a8486-ec57-4d52-9f58-3c82132a2639 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:42:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-2ae127db-1e41-4c08-b4a5-df5c84d2f2c9 req-229a8486-ec57-4d52-9f58-3c82132a2639 service nova] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:42:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:42:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:42:46 user nova-compute[75020]: INFO nova.compute.manager [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Detaching volume a332f9df-e0b1-4d11-a746-08b659b49144
Nov 30 11:42:46 user nova-compute[75020]: INFO nova.virt.block_device [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Attempting to driver detach volume a332f9df-e0b1-4d11-a746-08b659b49144 from mountpoint /dev/vdb
Nov 30 11:42:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Attempting to detach device vdb from instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:42:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:42:46 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:42:46 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:42:46 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:42:46 user nova-compute[75020]:   <serial>a332f9df-e0b1-4d11-a746-08b659b49144</serial>
Nov 30 11:42:46 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 11:42:46 user nova-compute[75020]: </disk>
Nov 30 11:42:46 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:42:46 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully detached device vdb from instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 from the persistent domain config.
Nov 30 11:42:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:42:46 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:42:46 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:42:46 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:42:46 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:42:46 user nova-compute[75020]:   <serial>a332f9df-e0b1-4d11-a746-08b659b49144</serial>
Nov 30 11:42:46 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 11:42:46 user nova-compute[75020]: </disk>
Nov 30 11:42:46 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-0a380968-0d08-49de-a7dc-c3d354e5ea0b req-a4cdf742-99c2-439d-b474-b7af8903a037 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG nova.compute.manager [req-0a380968-0d08-49de-a7dc-c3d354e5ea0b req-a4cdf742-99c2-439d-b474-b7af8903a037 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing instance network info cache due to event network-changed-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0a380968-0d08-49de-a7dc-c3d354e5ea0b req-a4cdf742-99c2-439d-b474-b7af8903a037 service nova] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0a380968-0d08-49de-a7dc-c3d354e5ea0b req-a4cdf742-99c2-439d-b474-b7af8903a037 service nova] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-0a380968-0d08-49de-a7dc-c3d354e5ea0b req-a4cdf742-99c2-439d-b474-b7af8903a037 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Refreshing network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-0a380968-0d08-49de-a7dc-c3d354e5ea0b req-a4cdf742-99c2-439d-b474-b7af8903a037 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated VIF entry in instance network info cache for port 7e29ad13-80dd-4c70-a4b9-b7f17012fc3e. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG nova.network.neutron [req-0a380968-0d08-49de-a7dc-c3d354e5ea0b req-a4cdf742-99c2-439d-b474-b7af8903a037 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0a380968-0d08-49de-a7dc-c3d354e5ea0b req-a4cdf742-99c2-439d-b474-b7af8903a037 service nova] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:42:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:42:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:42:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:42:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:42:58 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:07 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 is timed out.
Nov 30 11:43:07 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully detached device vdb from instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 from the live domain config.
Nov 30 11:43:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouQlxAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:43:07 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d048c13-452a-472a-82cb-f2b4f4fe37a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:43:07 user nova-compute[75020]: No targets found.
Nov 30 11:43:07 user nova-compute[75020]: iSNS:
Nov 30 11:43:07 user nova-compute[75020]: No targets found.
Nov 30 11:43:07 user nova-compute[75020]: STATIC:
Nov 30 11:43:07 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144
Nov 30 11:43:07 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:43:07 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:43:07 user nova-compute[75020]: FIRMWARE:
Nov 30 11:43:07 user nova-compute[75020]: No targets found.
Nov 30 11:43:07 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:43:07 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:43:07 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a471ca67-40fb-44ea-b86b-d58fa298da7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb59166d-ef18-49d8-9bde-3eada1fed165]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)
Nov 30 11:43:07 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 (non-flash)
Nov 30 11:43:07 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad883097e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c08f8de-2c64-4f47-aea1-e65ed33f16fe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[180e766f-aeb2-4663-8195-9c93116ac371]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa32a99-35c6-4764-aafb-a9c67326b91b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9295e9d6-7e67-4774-b951-2de388c1d6f0]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1438e8-e3ee-40b8-9d31-7ae471609d31]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9bb76-8c31-46bc-9dee-2fc76a312f37]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260]
Nov 30 11:43:07 user nova-compute[75020]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144, portal: 172.16.0.220,3260] successful.
Nov 30 11:43:07 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a332f9df-e0b1-4d11-a746-08b659b49144 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39881b7-c36e-4a31-bb9b-2afa52fe67e2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] <== disconnect_volume: return (293ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:43:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:08 user nova-compute[75020]: DEBUG nova.objects.instance [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'flavor' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:43:08 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9268f232-3a3f-495c-8b57-f47f484af464 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:43:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:43:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:43:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:43:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:43:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:43:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:43:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:23 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:43:29 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:43:29 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:43:29 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=25.081836700439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:43:29 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:43:30 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:43:30 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:43:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [{"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-7b8eaadd-e3fb-443a-9246-e580ab61eef3" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:43:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:43:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:43:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:43:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:43:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:43:41 user nova-compute[75020]: INFO nova.compute.manager [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Terminating instance
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-d9b7a3c5-ccf8-4f95-9899-043055b270dd req-bb861dfc-e1d0-4750-8aaa-7c168b1997a9 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-unplugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9b7a3c5-ccf8-4f95-9899-043055b270dd req-bb861dfc-e1d0-4750-8aaa-7c168b1997a9 service nova] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9b7a3c5-ccf8-4f95-9899-043055b270dd req-bb861dfc-e1d0-4750-8aaa-7c168b1997a9 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-d9b7a3c5-ccf8-4f95-9899-043055b270dd req-bb861dfc-e1d0-4750-8aaa-7c168b1997a9 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-d9b7a3c5-ccf8-4f95-9899-043055b270dd req-bb861dfc-e1d0-4750-8aaa-7c168b1997a9 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] No waiting events found dispatching network-vif-unplugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-d9b7a3c5-ccf8-4f95-9899-043055b270dd req-bb861dfc-e1d0-4750-8aaa-7c168b1997a9 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-unplugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Instance destroyed successfully.
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'resources' on Instance uuid 7b8eaadd-e3fb-443a-9246-e580ab61eef3 {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1531415780',display_name='tempest-TestMinimumBasicScenario-server-1531415780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1531415780',id=50,image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuTAMwSmLDjPzspNaOaFzxDdK0v2fm3Q6MK2vIJ/MKrqWaBrOhbW/04cmfqLsDQ+mG5CyGuRW/lGPgGgk1KduqzNb6BBPQygDrJQEPRkinEEtSt/s99ESZBqRXAkSx/Sw==',key_name='tempest-TestMinimumBasicScenario-1716386495',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:38:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-0xznzbi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b98b52b-8414-4c1a-8bc2-fc77d6af983a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:41:01Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=7b8eaadd-e3fb-443a-9246-e580ab61eef3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "address": "fa:16:3e:73:bd:c3", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e29ad13-80", "ovs_interfaceid": "7e29ad13-80dd-4c70-a4b9-b7f17012fc3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG os_vif [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e29ad13-80, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95eef9c1-f799-441b-b3f1-90811b998f16) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:43:41 user nova-compute[75020]: INFO os_vif [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:bd:c3,bridge_name='br-int',has_traffic_filtering=True,id=7e29ad13-80dd-4c70-a4b9-b7f17012fc3e,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e29ad13-80')
Nov 30 11:43:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Deleting instance files /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3_del
Nov 30 11:43:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Deletion of /opt/stack/data/nova/instances/7b8eaadd-e3fb-443a-9246-e580ab61eef3_del complete
Nov 30 11:43:41 user nova-compute[75020]: INFO nova.compute.manager [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 11:43:41 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:43:41 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:43:42 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:43:42 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Took 0.58 seconds to deallocate network for instance.
Nov 30 11:43:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:43:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:43:42 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:43:42 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:43:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:43:42 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Deleted allocations for instance 7b8eaadd-e3fb-443a-9246-e580ab61eef3
Nov 30 11:43:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-9a5f278d-b47d-4cd5-8661-c54836453fb3 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.811s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:43:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-092c1fe1-a982-4053-92f1-5e2ebd088a38 req-4da90218-3ca5-428d-9c33-331a9a2717c3 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:43:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-092c1fe1-a982-4053-92f1-5e2ebd088a38 req-4da90218-3ca5-428d-9c33-331a9a2717c3 service nova] Acquiring lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:43:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-092c1fe1-a982-4053-92f1-5e2ebd088a38 req-4da90218-3ca5-428d-9c33-331a9a2717c3 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:43:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-092c1fe1-a982-4053-92f1-5e2ebd088a38 req-4da90218-3ca5-428d-9c33-331a9a2717c3 service nova] Lock "7b8eaadd-e3fb-443a-9246-e580ab61eef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:43:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-092c1fe1-a982-4053-92f1-5e2ebd088a38 req-4da90218-3ca5-428d-9c33-331a9a2717c3 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] No waiting events found dispatching network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:43:43 user nova-compute[75020]: WARNING nova.compute.manager [req-092c1fe1-a982-4053-92f1-5e2ebd088a38 req-4da90218-3ca5-428d-9c33-331a9a2717c3 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received unexpected event network-vif-plugged-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e for instance with vm_state deleted and task_state None.
Nov 30 11:43:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-092c1fe1-a982-4053-92f1-5e2ebd088a38 req-4da90218-3ca5-428d-9c33-331a9a2717c3 service nova] [instance: 7b8eaadd-e3fb-443a-9246-e580ab61eef3] Received event network-vif-deleted-7e29ad13-80dd-4c70-a4b9-b7f17012fc3e {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:43:46 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:43:56 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:44:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:44:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:44:01 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:06 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:11 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:16 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:18 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:19 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:21 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:26 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:44:31 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:44:31 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9186MB free_disk=25.109233856201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:44:35 user nova-compute[75020]: INFO nova.compute.claims [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Claim successful on node user
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:44:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.policy [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dbed147b4e34ee397e9eb565c5b970e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62125bd386d84f3ea13f872ba8a77a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:44:35 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Creating image(s)
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "/opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "/opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "/opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "c406e9c8205bf0dfbbca0b23594897f90f565e9e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "c406e9c8205bf0dfbbca0b23594897f90f565e9e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e.part --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Successfully created port: 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG nova.virt.images [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] 80e8d055-0a74-42b3-a3cf-e83e28a9f334 was qcow2, converting to raw {{(pid=75020) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG nova.privsep.utils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75020) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e.part /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e.converted {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e.part /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e.converted" returned: 0 in 0.348s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e.converted --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:44:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "c406e9c8205bf0dfbbca0b23594897f90f565e9e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.215s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Successfully updated port: 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf8ec40b-5b6a-4ffb-90cc-8eeb9a1d673a req-44d7ea8c-6700-4553-a52f-c62989a20ba0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.compute.manager [req-cf8ec40b-5b6a-4ffb-90cc-8eeb9a1d673a req-44d7ea8c-6700-4553-a52f-c62989a20ba0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing instance network info cache due to event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf8ec40b-5b6a-4ffb-90cc-8eeb9a1d673a req-44d7ea8c-6700-4553-a52f-c62989a20ba0 service nova] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "c406e9c8205bf0dfbbca0b23594897f90f565e9e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "c406e9c8205bf0dfbbca0b23594897f90f565e9e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e --force-share --output=json" returned: 0 in 0.169s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e,backing_fmt=raw /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e,backing_fmt=raw /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk 1073741824" returned: 0 in 0.056s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "c406e9c8205bf0dfbbca0b23594897f90f565e9e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.neutron [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Instance network_info: |[{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf8ec40b-5b6a-4ffb-90cc-8eeb9a1d673a req-44d7ea8c-6700-4553-a52f-c62989a20ba0 service nova] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-cf8ec40b-5b6a-4ffb-90cc-8eeb9a1d673a req-44d7ea8c-6700-4553-a52f-c62989a20ba0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c406e9c8205bf0dfbbca0b23594897f90f565e9e --force-share --output=json" returned: 0 in 0.171s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Cannot resize image /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Ensure instance console log exists: /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Start _get_guest_xml network_info=[{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T11:44:33Z,direct_url=<?>,disk_format='qcow2',id=80e8d055-0a74-42b3-a3cf-e83e28a9f334,min_disk=0,min_ram=0,name='tempest-scenario-img--2099519279',owner='62125bd386d84f3ea13f872ba8a77a47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T11:44:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': '80e8d055-0a74-42b3-a3cf-e83e28a9f334'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:44:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:44:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T11:44:33Z,direct_url=<?>,disk_format='qcow2',id=80e8d055-0a74-42b3-a3cf-e83e28a9f334,min_disk=0,min_ram=0,name='tempest-scenario-img--2099519279',owner='62125bd386d84f3ea13f872ba8a77a47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T11:44:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-500195655',display_name='tempest-TestMinimumBasicScenario-server-500195655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-500195655',id=51,image_ref='80e8d055-0a74-42b3-a3cf-e83e28a9f334',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOheTNBSLzSxst8nqiloLQjzx4bh+iMCnBZFg3hMyGJWYPccdmfmP/4QM0iY0nxY5prQt6Rz3gDsOsehMBx15kjGo3tfsXoa3rnFL+Om6dtV5x+9gfrt76pbLoCgBQuHiQ==',key_name='tempest-TestMinimumBasicScenario-987819746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-lirzawqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='80e8d055-0a74-42b3-a3cf-e83e28a9f334',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:44:36Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=24c45e30-0753-4a85-a994-ffcba4ba8cbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:44:5e,bridge_name='br-int',has_traffic_filtering=True,id=25f13cfa-a376-4ee6-8fe8-ddd67dd65c84,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f13cfa-a3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.objects.instance [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'pci_devices' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:44:37 user nova-compute[75020]:   <uuid>24c45e30-0753-4a85-a994-ffcba4ba8cbb</uuid>
Nov 30 11:44:37 user nova-compute[75020]:   <name>instance-00000033</name>
Nov 30 11:44:37 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:44:37 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:44:37 user nova-compute[75020]:   <metadata>
Nov 30 11:44:37 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:44:37 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:44:37 user nova-compute[75020]:       <nova:name>tempest-TestMinimumBasicScenario-server-500195655</nova:name>
Nov 30 11:44:37 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:44:37</nova:creationTime>
Nov 30 11:44:37 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:44:37 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:44:37 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:44:37 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:44:37 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:44:37 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:44:37 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:44:37 user nova-compute[75020]:       <nova:owner>
Nov 30 11:44:37 user nova-compute[75020]:         <nova:user uuid="1dbed147b4e34ee397e9eb565c5b970e">tempest-TestMinimumBasicScenario-1701357472-project-member</nova:user>
Nov 30 11:44:37 user nova-compute[75020]:         <nova:project uuid="62125bd386d84f3ea13f872ba8a77a47">tempest-TestMinimumBasicScenario-1701357472</nova:project>
Nov 30 11:44:37 user nova-compute[75020]:       </nova:owner>
Nov 30 11:44:37 user nova-compute[75020]:       <nova:root type="image" uuid="80e8d055-0a74-42b3-a3cf-e83e28a9f334"/>
Nov 30 11:44:37 user nova-compute[75020]:       <nova:ports>
Nov 30 11:44:37 user nova-compute[75020]:         <nova:port uuid="25f13cfa-a376-4ee6-8fe8-ddd67dd65c84">
Nov 30 11:44:37 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 11:44:37 user nova-compute[75020]:         </nova:port>
Nov 30 11:44:37 user nova-compute[75020]:       </nova:ports>
Nov 30 11:44:37 user nova-compute[75020]:     </nova:instance>
Nov 30 11:44:37 user nova-compute[75020]:   </metadata>
Nov 30 11:44:37 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:44:37 user nova-compute[75020]:     <system>
Nov 30 11:44:37 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:44:37 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:44:37 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:44:37 user nova-compute[75020]:       <entry name="serial">24c45e30-0753-4a85-a994-ffcba4ba8cbb</entry>
Nov 30 11:44:37 user nova-compute[75020]:       <entry name="uuid">24c45e30-0753-4a85-a994-ffcba4ba8cbb</entry>
Nov 30 11:44:37 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:44:37 user nova-compute[75020]:     </system>
Nov 30 11:44:37 user nova-compute[75020]:   </sysinfo>
Nov 30 11:44:37 user nova-compute[75020]:   <os>
Nov 30 11:44:37 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:44:37 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:44:37 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:44:37 user nova-compute[75020]:   </os>
Nov 30 11:44:37 user nova-compute[75020]:   <features>
Nov 30 11:44:37 user nova-compute[75020]:     <acpi/>
Nov 30 11:44:37 user nova-compute[75020]:     <apic/>
Nov 30 11:44:37 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:44:37 user nova-compute[75020]:   </features>
Nov 30 11:44:37 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:44:37 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:44:37 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:44:37 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:44:37 user nova-compute[75020]:   </clock>
Nov 30 11:44:37 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:44:37 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:44:37 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:44:37 user nova-compute[75020]:   </cpu>
Nov 30 11:44:37 user nova-compute[75020]:   <devices>
Nov 30 11:44:37 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:44:37 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:44:37 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk"/>
Nov 30 11:44:37 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:44:37 user nova-compute[75020]:     </disk>
Nov 30 11:44:37 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:44:37 user nova-compute[75020]:       <mac address="fa:16:3e:71:44:5e"/>
Nov 30 11:44:37 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:44:37 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:44:37 user nova-compute[75020]:       <target dev="tap25f13cfa-a3"/>
Nov 30 11:44:37 user nova-compute[75020]:     </interface>
Nov 30 11:44:37 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:44:37 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/console.log" append="off"/>
Nov 30 11:44:37 user nova-compute[75020]:     </serial>
Nov 30 11:44:37 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:44:37 user nova-compute[75020]:     <video>
Nov 30 11:44:37 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:44:37 user nova-compute[75020]:     </video>
Nov 30 11:44:37 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:44:37 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:44:37 user nova-compute[75020]:     </rng>
Nov 30 11:44:37 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:44:37 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:44:37 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:44:37 user nova-compute[75020]:     </memballoon>
Nov 30 11:44:37 user nova-compute[75020]:   </devices>
Nov 30 11:44:37 user nova-compute[75020]: </domain>
Nov 30 11:44:37 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-500195655',display_name='tempest-TestMinimumBasicScenario-server-500195655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-500195655',id=51,image_ref='80e8d055-0a74-42b3-a3cf-e83e28a9f334',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOheTNBSLzSxst8nqiloLQjzx4bh+iMCnBZFg3hMyGJWYPccdmfmP/4QM0iY0nxY5prQt6Rz3gDsOsehMBx15kjGo3tfsXoa3rnFL+Om6dtV5x+9gfrt76pbLoCgBQuHiQ==',key_name='tempest-TestMinimumBasicScenario-987819746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-lirzawqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='80e8d055-0a74-42b3-a3cf-e83e28a9f334',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:44:36Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=24c45e30-0753-4a85-a994-ffcba4ba8cbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:44:5e,bridge_name='br-int',has_traffic_filtering=True,id=25f13cfa-a376-4ee6-8fe8-ddd67dd65c84,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f13cfa-a3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG os_vif [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:44:5e,bridge_name='br-int',has_traffic_filtering=True,id=25f13cfa-a376-4ee6-8fe8-ddd67dd65c84,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f13cfa-a3') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f286a25-af3d-53bc-b874-026187b237e6', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25f13cfa-a3, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25f13cfa-a3, col_values=(('qos', UUID('e1c12485-a923-4ed9-8555-e1dc5b8bb748')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25f13cfa-a3, col_values=(('external_ids', {'iface-id': '25f13cfa-a376-4ee6-8fe8-ddd67dd65c84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:44:5e', 'vm-uuid': '24c45e30-0753-4a85-a994-ffcba4ba8cbb'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:37 user nova-compute[75020]: INFO os_vif [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:44:5e,bridge_name='br-int',has_traffic_filtering=True,id=25f13cfa-a376-4ee6-8fe8-ddd67dd65c84,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f13cfa-a3')
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-cf8ec40b-5b6a-4ffb-90cc-8eeb9a1d673a req-44d7ea8c-6700-4553-a52f-c62989a20ba0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated VIF entry in instance network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.network.neutron [req-cf8ec40b-5b6a-4ffb-90cc-8eeb9a1d673a req-44d7ea8c-6700-4553-a52f-c62989a20ba0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-cf8ec40b-5b6a-4ffb-90cc-8eeb9a1d673a req-44d7ea8c-6700-4553-a52f-c62989a20ba0 service nova] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:44:37 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No VIF found with MAC fa:16:3e:71:44:5e, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:44:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:44:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-c9f5429b-dd55-40e9-a546-c15d27cdd87b req-3f415878-e024-44ba-9777-008c5710dc5c service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c9f5429b-dd55-40e9-a546-c15d27cdd87b req-3f415878-e024-44ba-9777-008c5710dc5c service nova] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c9f5429b-dd55-40e9-a546-c15d27cdd87b req-3f415878-e024-44ba-9777-008c5710dc5c service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c9f5429b-dd55-40e9-a546-c15d27cdd87b req-3f415878-e024-44ba-9777-008c5710dc5c service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-c9f5429b-dd55-40e9-a546-c15d27cdd87b req-3f415878-e024-44ba-9777-008c5710dc5c service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] No waiting events found dispatching network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:44:39 user nova-compute[75020]: WARNING nova.compute.manager [req-c9f5429b-dd55-40e9-a546-c15d27cdd87b req-3f415878-e024-44ba-9777-008c5710dc5c service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received unexpected event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 for instance with vm_state building and task_state spawning.
Nov 30 11:44:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:44:41 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Instance spawned successfully.
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-0db388b4-0a2b-473f-ba0c-7bf1090dc483 req-f9f80a27-34cd-4686-a3b4-6eea6d694e07 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0db388b4-0a2b-473f-ba0c-7bf1090dc483 req-f9f80a27-34cd-4686-a3b4-6eea6d694e07 service nova] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0db388b4-0a2b-473f-ba0c-7bf1090dc483 req-f9f80a27-34cd-4686-a3b4-6eea6d694e07 service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-0db388b4-0a2b-473f-ba0c-7bf1090dc483 req-f9f80a27-34cd-4686-a3b4-6eea6d694e07 service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.compute.manager [req-0db388b4-0a2b-473f-ba0c-7bf1090dc483 req-f9f80a27-34cd-4686-a3b4-6eea6d694e07 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] No waiting events found dispatching network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:44:41 user nova-compute[75020]: WARNING nova.compute.manager [req-0db388b4-0a2b-473f-ba0c-7bf1090dc483 req-f9f80a27-34cd-4686-a3b4-6eea6d694e07 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received unexpected event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 for instance with vm_state building and task_state spawning.
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:44:41 user nova-compute[75020]: INFO nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 30 11:44:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:44:41 user nova-compute[75020]: INFO nova.compute.manager [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Took 6.39 seconds to build instance.
Nov 30 11:44:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-f90014c5-b0c8-48e8-b9af-7e707f36a0cd tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.485s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:44:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:44:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:44:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:44:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:44:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:44:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:04 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:04 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Triggering sync for uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 11:45:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:45:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:45:04 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:45:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:06 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:14 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:14 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:45:14 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:45:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:21 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:45:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:45:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:45:33 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:45:33 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:45:33 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=25.058734893798828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:45:33 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:45:34 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:45:34 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:45:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:45:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:45:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:45:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:45:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:45:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:45:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:45:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:45:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:45:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:45:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:47 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:45:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:45:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:45:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:45:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:45:57 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:46:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:02 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:07 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:46:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:17 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:22 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:46:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:22 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:22 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:46:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:28 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:28 user nova-compute[75020]: DEBUG nova.objects.instance [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'flavor' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:29 user nova-compute[75020]: INFO nova.compute.manager [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Attaching volume 27c656b0-988b-4c65-8bf8-6ec301666da5 to /dev/vdb
Nov 30 11:46:29 user nova-compute[75020]: DEBUG os_brick.utils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb8e8e7-e6d8-43e0-b157-5e58833c5e86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5071a47c-bb75-4b95-91a4-31fd3cb5b29e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff7fefd-31ee-4761-b9c7-1cae6f7a506e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb7660-3519-4424-832a-3bf373829573]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:46:29 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:46:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a1fbed-54b8-4a6a-9715-62bed9d8fdda]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG os_brick.utils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:46:29 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating existing volume attachment record: 84b9b086-fc4b-4eb3-b529-2913f491b4a7 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:46:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:46:32 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:34 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:46:34 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:46:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9040MB free_disk=25.0579833984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:46:34 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:46:35 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:46:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:37 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcomiPkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:46:38 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:46:38 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:46:38 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1470550d-2acf-48b9-99f3-53ca0bf670a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:46:38 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae90f81a-313a-44b4-9811-339e6c72d221]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5] added
Nov 30 11:46:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[507b66c6-86fa-4e8e-ab33-655ea945c725]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a0f9a-7846-4c93-ad71-7b322ca7dac7]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcomiPkf {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcomiPkf" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4aea50-ffaa-4467-8584-dac8d70440d9]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcomiPkf'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90ffe0e-85a8-4a97-8ca0-c2957e03cb0d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb28a0e-571d-4231-8a7f-c1496388faf3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:46:38 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:46:38 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:46:38 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:46:38 user nova-compute[75020]: 
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11123a7-70a2-4639-9425-983a9867df11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5, portal: 172.16.0.220,3260]
Nov 30 11:46:38 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5, portal: 172.16.0.220,3260] successful.
Nov 30 11:46:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b27318-35f8-41c8-a7db-9f1dfe4c47b6]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d521a9-729b-4b68-9a77-88bbf81e577d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 (non-flash)
Nov 30 11:46:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 (non-flash)
Nov 30 11:46:38 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4fda84-0d15-4d30-a47b-b5318339a872]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:46:38 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcomiPkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26534663038623664', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534663038623664', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG nova.objects.instance [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'flavor' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:46:39 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:46:39 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:46:39 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:46:39 user nova-compute[75020]:   <serial>27c656b0-988b-4c65-8bf8-6ec301666da5</serial>
Nov 30 11:46:39 user nova-compute[75020]: </disk>
Nov 30 11:46:39 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] No VIF found with MAC fa:16:3e:71:44:5e, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:46:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-24136e67-fc08-4d3d-b51e-50a84aa67eb1 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.793s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:41 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-4bbdb29d-fb27-420b-9813-725d1f9ad71a req-29c68e35-0f75-417f-96fe-fc84d257f4db service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:46:43 user nova-compute[75020]: DEBUG nova.compute.manager [req-4bbdb29d-fb27-420b-9813-725d1f9ad71a req-29c68e35-0f75-417f-96fe-fc84d257f4db service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing instance network info cache due to event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:46:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4bbdb29d-fb27-420b-9813-725d1f9ad71a req-29c68e35-0f75-417f-96fe-fc84d257f4db service nova] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:46:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4bbdb29d-fb27-420b-9813-725d1f9ad71a req-29c68e35-0f75-417f-96fe-fc84d257f4db service nova] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:46:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-4bbdb29d-fb27-420b-9813-725d1f9ad71a req-29c68e35-0f75-417f-96fe-fc84d257f4db service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:46:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-4bbdb29d-fb27-420b-9813-725d1f9ad71a req-29c68e35-0f75-417f-96fe-fc84d257f4db service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated VIF entry in instance network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:46:43 user nova-compute[75020]: DEBUG nova.network.neutron [req-4bbdb29d-fb27-420b-9813-725d1f9ad71a req-29c68e35-0f75-417f-96fe-fc84d257f4db service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:46:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-4bbdb29d-fb27-420b-9813-725d1f9ad71a req-29c68e35-0f75-417f-96fe-fc84d257f4db service nova] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:46:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-1ff9f72e-f5c0-4946-b3a5-68965003a1f3 req-cff1427b-2bd4-424b-af33-6869c6224301 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:46:45 user nova-compute[75020]: DEBUG nova.compute.manager [req-1ff9f72e-f5c0-4946-b3a5-68965003a1f3 req-cff1427b-2bd4-424b-af33-6869c6224301 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing instance network info cache due to event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:46:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ff9f72e-f5c0-4946-b3a5-68965003a1f3 req-cff1427b-2bd4-424b-af33-6869c6224301 service nova] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:46:45 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ff9f72e-f5c0-4946-b3a5-68965003a1f3 req-cff1427b-2bd4-424b-af33-6869c6224301 service nova] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:46:45 user nova-compute[75020]: DEBUG nova.network.neutron [req-1ff9f72e-f5c0-4946-b3a5-68965003a1f3 req-cff1427b-2bd4-424b-af33-6869c6224301 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:46 user nova-compute[75020]: INFO nova.compute.manager [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Rebooting instance
Nov 30 11:46:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG nova.network.neutron [req-1ff9f72e-f5c0-4946-b3a5-68965003a1f3 req-cff1427b-2bd4-424b-af33-6869c6224301 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated VIF entry in instance network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG nova.network.neutron [req-1ff9f72e-f5c0-4946-b3a5-68965003a1f3 req-cff1427b-2bd4-424b-af33-6869c6224301 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1ff9f72e-f5c0-4946-b3a5-68965003a1f3 req-cff1427b-2bd4-424b-af33-6869c6224301 service nova] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG nova.network.neutron [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:46:46 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:46:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-773a3398-cef2-4ebd-96f2-64253e96f0f3 req-0ab0868a-875d-49be-941d-29e2d1f53d0d service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-unplugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:46:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-773a3398-cef2-4ebd-96f2-64253e96f0f3 req-0ab0868a-875d-49be-941d-29e2d1f53d0d service nova] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-773a3398-cef2-4ebd-96f2-64253e96f0f3 req-0ab0868a-875d-49be-941d-29e2d1f53d0d service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-773a3398-cef2-4ebd-96f2-64253e96f0f3 req-0ab0868a-875d-49be-941d-29e2d1f53d0d service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-773a3398-cef2-4ebd-96f2-64253e96f0f3 req-0ab0868a-875d-49be-941d-29e2d1f53d0d service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] No waiting events found dispatching network-vif-unplugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:46:49 user nova-compute[75020]: WARNING nova.compute.manager [req-773a3398-cef2-4ebd-96f2-64253e96f0f3 req-0ab0868a-875d-49be-941d-29e2d1f53d0d service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received unexpected event network-vif-unplugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 for instance with vm_state active and task_state reboot_started.
Nov 30 11:46:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:49 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Instance shutdown successfully.
Nov 30 11:46:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-c20bc336-4de0-4a24-a122-320d0871e9c8 req-b8c639f0-acf6-453c-950d-ceeb1f06d35d service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c20bc336-4de0-4a24-a122-320d0871e9c8 req-b8c639f0-acf6-453c-950d-ceeb1f06d35d service nova] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c20bc336-4de0-4a24-a122-320d0871e9c8 req-b8c639f0-acf6-453c-950d-ceeb1f06d35d service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-c20bc336-4de0-4a24-a122-320d0871e9c8 req-b8c639f0-acf6-453c-950d-ceeb1f06d35d service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-c20bc336-4de0-4a24-a122-320d0871e9c8 req-b8c639f0-acf6-453c-950d-ceeb1f06d35d service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] No waiting events found dispatching network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:46:51 user nova-compute[75020]: WARNING nova.compute.manager [req-c20bc336-4de0-4a24-a122-320d0871e9c8 req-b8c639f0-acf6-453c-950d-ceeb1f06d35d service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received unexpected event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 for instance with vm_state active and task_state reboot_started.
Nov 30 11:46:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:53 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Instance running successfully.
Nov 30 11:46:53 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Instance soft rebooted successfully.
Nov 30 11:46:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] No waiting events found dispatching network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:46:53 user nova-compute[75020]: WARNING nova.compute.manager [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received unexpected event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 for instance with vm_state active and task_state reboot_started.
Nov 30 11:46:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] No waiting events found dispatching network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:46:53 user nova-compute[75020]: WARNING nova.compute.manager [req-65348d46-9b9a-4cb1-b3c3-1b551fd0a69d req-933a2ba5-ee00-4303-8891-678183cc61a0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received unexpected event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 for instance with vm_state active and task_state reboot_started.
Nov 30 11:46:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-7eb5844b-911e-44b6-8f9a-8baacd52172f tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.241s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:46:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:46:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:07 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:22 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:47:32 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:47:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:47:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:47:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.048282623291016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:47:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:47:37 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:47:37 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:47:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:47:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:47:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:40 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:47:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:47:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:47:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:47:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:48:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:23 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:48:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:25 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:48:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:48:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:48:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:48:36 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=25.047725677490234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:48:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:48:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-8ca330ba-43f4-4b67-853f-06251f314804 req-efa282e0-a5a5-4b2b-92b0-58975591f1e0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG nova.compute.manager [req-8ca330ba-43f4-4b67-853f-06251f314804 req-efa282e0-a5a5-4b2b-92b0-58975591f1e0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing instance network info cache due to event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8ca330ba-43f4-4b67-853f-06251f314804 req-efa282e0-a5a5-4b2b-92b0-58975591f1e0 service nova] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8ca330ba-43f4-4b67-853f-06251f314804 req-efa282e0-a5a5-4b2b-92b0-58975591f1e0 service nova] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-8ca330ba-43f4-4b67-853f-06251f314804 req-efa282e0-a5a5-4b2b-92b0-58975591f1e0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-8ca330ba-43f4-4b67-853f-06251f314804 req-efa282e0-a5a5-4b2b-92b0-58975591f1e0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated VIF entry in instance network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG nova.network.neutron [req-8ca330ba-43f4-4b67-853f-06251f314804 req-efa282e0-a5a5-4b2b-92b0-58975591f1e0 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:48:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-8ca330ba-43f4-4b67-853f-06251f314804 req-efa282e0-a5a5-4b2b-92b0-58975591f1e0 service nova] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-e4bc6c57-27a3-4162-92d1-489f7f1cf81a req-14e2bfad-f610-4b9b-a27c-79736e9eaefd service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-e4bc6c57-27a3-4162-92d1-489f7f1cf81a req-14e2bfad-f610-4b9b-a27c-79736e9eaefd service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing instance network info cache due to event network-changed-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4bc6c57-27a3-4162-92d1-489f7f1cf81a req-14e2bfad-f610-4b9b-a27c-79736e9eaefd service nova] Acquiring lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4bc6c57-27a3-4162-92d1-489f7f1cf81a req-14e2bfad-f610-4b9b-a27c-79736e9eaefd service nova] Acquired lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-e4bc6c57-27a3-4162-92d1-489f7f1cf81a req-14e2bfad-f610-4b9b-a27c-79736e9eaefd service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Refreshing network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:48:39 user nova-compute[75020]: INFO nova.compute.manager [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Detaching volume 27c656b0-988b-4c65-8bf8-6ec301666da5
Nov 30 11:48:39 user nova-compute[75020]: INFO nova.virt.block_device [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Attempting to driver detach volume 27c656b0-988b-4c65-8bf8-6ec301666da5 from mountpoint /dev/vdb
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Attempting to detach device vdb from instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:48:39 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:48:39 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:48:39 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:48:39 user nova-compute[75020]:   <serial>27c656b0-988b-4c65-8bf8-6ec301666da5</serial>
Nov 30 11:48:39 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:48:39 user nova-compute[75020]: </disk>
Nov 30 11:48:39 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:48:39 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully detached device vdb from instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb from the persistent domain config.
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:48:39 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:48:39 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:48:39 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:48:39 user nova-compute[75020]:   <serial>27c656b0-988b-4c65-8bf8-6ec301666da5</serial>
Nov 30 11:48:39 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:48:39 user nova-compute[75020]: </disk>
Nov 30 11:48:39 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-e4bc6c57-27a3-4162-92d1-489f7f1cf81a req-14e2bfad-f610-4b9b-a27c-79736e9eaefd service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updated VIF entry in instance network info cache for port 25f13cfa-a376-4ee6-8fe8-ddd67dd65c84. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-e4bc6c57-27a3-4162-92d1-489f7f1cf81a req-14e2bfad-f610-4b9b-a27c-79736e9eaefd service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [{"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-e4bc6c57-27a3-4162-92d1-489f7f1cf81a req-14e2bfad-f610-4b9b-a27c-79736e9eaefd service nova] Releasing lock "refresh_cache-24c45e30-0753-4a85-a994-ffcba4ba8cbb" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:48:39 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:48:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:48:42 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:48:43 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:48:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:48:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:48:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:48:48 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:48:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:48:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:48:53 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:48:58 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:48:59 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb is timed out.
Nov 30 11:48:59 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully detached device vdb from instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb from the live domain config.
Nov 30 11:48:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcomiPkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:48:59 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d35267-10a6-415b-adf8-807a50a24a2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:48:59 user nova-compute[75020]: No targets found.
Nov 30 11:48:59 user nova-compute[75020]: iSNS:
Nov 30 11:48:59 user nova-compute[75020]: No targets found.
Nov 30 11:48:59 user nova-compute[75020]: STATIC:
Nov 30 11:48:59 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5
Nov 30 11:48:59 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:48:59 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:48:59 user nova-compute[75020]: FIRMWARE:
Nov 30 11:48:59 user nova-compute[75020]: No targets found.
Nov 30 11:48:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:48:59 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:48:59 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f063b9-12c3-44d8-8fd8-0c69b3062e3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c268db-f3a1-4c0d-bb0e-cbc32f8acda6]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 (non-flash)
Nov 30 11:48:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 (non-flash)
Nov 30 11:48:59 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad8846b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03074f3-1701-4218-8b6a-e5c2e2121743]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a64333-94db-446e-8a2c-2ee9825142f1]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[616fc5dc-4049-4072-826f-c0813a4af949]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:48:59 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aed85fd-531e-4488-a40d-510571054547]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5ebb79-1e52-41b8-9335-66811e0c07be]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46820bb-a356-43ce-9e88-70509e336bab]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5, portal: 172.16.0.220,3260]
Nov 30 11:49:00 user nova-compute[75020]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5, portal: 172.16.0.220,3260] successful.
Nov 30 11:49:00 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27c656b0-988b-4c65-8bf8-6ec301666da5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff94eb4b-cf58-4702-bb12-f59014fcac2d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] <== disconnect_volume: return (297ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG nova.objects.instance [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'flavor' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:49:00 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-2f004f30-9bee-4afd-ba37-aef71a94e935 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:49:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:49:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:03 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:49:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:08 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:10 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:13 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:18 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:23 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:49:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:23 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:28 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:33 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:33 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:49:34 user nova-compute[75020]: INFO nova.compute.manager [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Terminating instance
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-f7a904f1-a9fb-43f7-9fb0-a55de70e2d32 req-55d1531b-b324-40f9-998a-41573846856c service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-unplugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f7a904f1-a9fb-43f7-9fb0-a55de70e2d32 req-55d1531b-b324-40f9-998a-41573846856c service nova] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f7a904f1-a9fb-43f7-9fb0-a55de70e2d32 req-55d1531b-b324-40f9-998a-41573846856c service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-f7a904f1-a9fb-43f7-9fb0-a55de70e2d32 req-55d1531b-b324-40f9-998a-41573846856c service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-f7a904f1-a9fb-43f7-9fb0-a55de70e2d32 req-55d1531b-b324-40f9-998a-41573846856c service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] No waiting events found dispatching network-vif-unplugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.compute.manager [req-f7a904f1-a9fb-43f7-9fb0-a55de70e2d32 req-55d1531b-b324-40f9-998a-41573846856c service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-unplugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:49:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Instance destroyed successfully.
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lazy-loading 'resources' on Instance uuid 24c45e30-0753-4a85-a994-ffcba4ba8cbb {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-500195655',display_name='tempest-TestMinimumBasicScenario-server-500195655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-500195655',id=51,image_ref='80e8d055-0a74-42b3-a3cf-e83e28a9f334',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOheTNBSLzSxst8nqiloLQjzx4bh+iMCnBZFg3hMyGJWYPccdmfmP/4QM0iY0nxY5prQt6Rz3gDsOsehMBx15kjGo3tfsXoa3rnFL+Om6dtV5x+9gfrt76pbLoCgBQuHiQ==',key_name='tempest-TestMinimumBasicScenario-987819746',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:44:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62125bd386d84f3ea13f872ba8a77a47',ramdisk_id='',reservation_id='r-lirzawqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='80e8d055-0a74-42b3-a3cf-e83e28a9f334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1701357472',owner_user_name='tempest-TestMinimumBasicScenario-1701357472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:46:53Z,user_data=None,user_id='1dbed147b4e34ee397e9eb565c5b970e',uuid=24c45e30-0753-4a85-a994-ffcba4ba8cbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converting VIF {"id": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "address": "fa:16:3e:71:44:5e", "network": {"id": "0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-439096871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62125bd386d84f3ea13f872ba8a77a47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f13cfa-a3", "ovs_interfaceid": "25f13cfa-a376-4ee6-8fe8-ddd67dd65c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:44:5e,bridge_name='br-int',has_traffic_filtering=True,id=25f13cfa-a376-4ee6-8fe8-ddd67dd65c84,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f13cfa-a3') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG os_vif [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:44:5e,bridge_name='br-int',has_traffic_filtering=True,id=25f13cfa-a376-4ee6-8fe8-ddd67dd65c84,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f13cfa-a3') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25f13cfa-a3, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1c12485-a923-4ed9-8555-e1dc5b8bb748) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:34 user nova-compute[75020]: INFO os_vif [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:44:5e,bridge_name='br-int',has_traffic_filtering=True,id=25f13cfa-a376-4ee6-8fe8-ddd67dd65c84,network=Network(0f56f2be-4fbd-4914-acaf-3f5f7c2da8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f13cfa-a3')
Nov 30 11:49:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Deleting instance files /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb_del
Nov 30 11:49:34 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Deletion of /opt/stack/data/nova/instances/24c45e30-0753-4a85-a994-ffcba4ba8cbb_del complete
Nov 30 11:49:34 user nova-compute[75020]: INFO nova.compute.manager [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 30 11:49:34 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:49:34 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:49:35 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Took 0.54 seconds to deallocate network for instance.
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.compute.manager [req-cfee612c-ccfa-4785-90af-46ee6de6ee10 req-95fc6979-6f14-4db8-918e-a60d5699f5e1 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-deleted-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:49:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:49:35 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Deleted allocations for instance 24c45e30-0753-4a85-a994-ffcba4ba8cbb
Nov 30 11:49:35 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0e44c5ab-ee30-4220-893c-712070237263 tempest-TestMinimumBasicScenario-1701357472 tempest-TestMinimumBasicScenario-1701357472-project-member] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.834s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-1e8e69ff-ffea-459f-90d5-994c9ba69023 req-1403d35f-8536-423a-b6a5-a7ed7cae5852 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1e8e69ff-ffea-459f-90d5-994c9ba69023 req-1403d35f-8536-423a-b6a5-a7ed7cae5852 service nova] Acquiring lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1e8e69ff-ffea-459f-90d5-994c9ba69023 req-1403d35f-8536-423a-b6a5-a7ed7cae5852 service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-1e8e69ff-ffea-459f-90d5-994c9ba69023 req-1403d35f-8536-423a-b6a5-a7ed7cae5852 service nova] Lock "24c45e30-0753-4a85-a994-ffcba4ba8cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:49:36 user nova-compute[75020]: DEBUG nova.compute.manager [req-1e8e69ff-ffea-459f-90d5-994c9ba69023 req-1403d35f-8536-423a-b6a5-a7ed7cae5852 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] No waiting events found dispatching network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:49:36 user nova-compute[75020]: WARNING nova.compute.manager [req-1e8e69ff-ffea-459f-90d5-994c9ba69023 req-1403d35f-8536-423a-b6a5-a7ed7cae5852 service nova] [instance: 24c45e30-0753-4a85-a994-ffcba4ba8cbb] Received unexpected event network-vif-plugged-25f13cfa-a376-4ee6-8fe8-ddd67dd65c84 for instance with vm_state deleted and task_state None.
Nov 30 11:49:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:49:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:49:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:49:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9151MB free_disk=25.074848175048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:49:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:49:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:49:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:40 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:44 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:49:44 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:49:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:49:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:49:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:49:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:49:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:04 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:50:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:50:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:50:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:50:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:50:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:50:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:27 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:28 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:50:28 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:50:29 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:31 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:34 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:35 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:36 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:50:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:50:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:50:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9162MB free_disk=25.113479614257812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:50:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:38 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:50:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:50:38 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:50:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:39 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:42 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:44 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:50:44 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:50:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Starting instance... {{(pid=75020) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 11:50:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:47 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:47 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75020) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 11:50:47 user nova-compute[75020]: INFO nova.compute.claims [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Claim successful on node user
Nov 30 11:50:47 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Start building networks asynchronously for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Allocating IP information in the background. {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] allocate_for_instance() {{(pid=75020) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 11:50:48 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Start building block device mappings for instance. {{(pid=75020) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.policy [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2baf7d9e1413499ea1b27554f23d01fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e609e714404de3923c5fa991ac3c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75020) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Start spawning the instance on the hypervisor. {{(pid=75020) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Creating instance directory {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 11:50:48 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Creating image(s)
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "/opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "/opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "/opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.170s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "c1d821214d135e408b9cb8db8af47c5218453814" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.169s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk 1073741824 {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814,backing_fmt=raw /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk 1073741824" returned: 0 in 0.053s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "c1d821214d135e408b9cb8db8af47c5218453814" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d821214d135e408b9cb8db8af47c5218453814 --force-share --output=json" returned: 0 in 0.169s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk. size=1073741824 {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 11:50:48 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.virt.disk.api [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Cannot resize image /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk to a smaller size. {{(pid=75020) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Created local disks {{(pid=75020) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Ensure instance console log exists: /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/console.log {{(pid=75020) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Successfully created port: 4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Successfully updated port: 4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquired lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Building network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-df72acf1-30a8-4712-9a6a-08a6388f6822 req-dbc4c026-fc1e-4461-9953-1b664d02873a service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received event network-changed-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.compute.manager [req-df72acf1-30a8-4712-9a6a-08a6388f6822 req-dbc4c026-fc1e-4461-9953-1b664d02873a service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Refreshing instance network info cache due to event network-changed-4d1dfac5-57b0-4cf5-bb1b-6206417421aa. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df72acf1-30a8-4712-9a6a-08a6388f6822 req-dbc4c026-fc1e-4461-9953-1b664d02873a service nova] Acquiring lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Instance cache missing network info. {{(pid=75020) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 11:50:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.network.neutron [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating instance_info_cache with network_info: [{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Releasing lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Instance network_info: |[{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75020) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df72acf1-30a8-4712-9a6a-08a6388f6822 req-dbc4c026-fc1e-4461-9953-1b664d02873a service nova] Acquired lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-df72acf1-30a8-4712-9a6a-08a6388f6822 req-dbc4c026-fc1e-4461-9953-1b664d02873a service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Refreshing network info cache for port 4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Start _get_guest_xml network_info=[{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'image_id': 'a0e347bf-fa3a-4008-b934-b96aa4570396'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 11:50:50 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:50:50 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] CPU controller missing on host. {{(pid=75020) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.host [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] CPU controller found on host. {{(pid=75020) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75020) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T10:43:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T10:44:01Z,direct_url=<?>,disk_format='qcow2',id=a0e347bf-fa3a-4008-b934-b96aa4570396,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='96dfc3e6d05049898231099132483b61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T10:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Flavor limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Image limits 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Flavor pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Image pref 0:0:0 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Got 1 possible topologies {{(pid=75020) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.hardware [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75020) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1823678634',display_name='tempest-TestServerVolumeAttachmentScenario-server-1823678634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1823678634',id=52,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKs/TsSPSADvAqhCRE6xckIZzDVI0T2zD8RTrgYHkgYPTagjCWUefCJ1uTNsU1k1zH25HHLx4LDVTLs6amBOcjO55CAMyVqWxJxQ5tnhObc2byyJoHQs6LzLLwso6sztOQ==',key_name='tempest-keypair-1469901248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8e609e714404de3923c5fa991ac3c74',ramdisk_id='',reservation_id='r-pqiz14k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-475220594',owner_user_name='tempest-TestServerVolumeAttachmentScenario-475220594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2baf7d9e1413499ea1b27554f23d01fd',uuid=86b16353-8fed-48d9-b99b-e702a7fe3a7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75020) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Converting VIF {"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=4d1dfac5-57b0-4cf5-bb1b-6206417421aa,network=Network(a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1dfac5-57') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lazy-loading 'pci_devices' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 11:50:50 user nova-compute[75020]:   <uuid>86b16353-8fed-48d9-b99b-e702a7fe3a7c</uuid>
Nov 30 11:50:50 user nova-compute[75020]:   <name>instance-00000034</name>
Nov 30 11:50:50 user nova-compute[75020]:   <memory>524288</memory>
Nov 30 11:50:50 user nova-compute[75020]:   <vcpu>1</vcpu>
Nov 30 11:50:50 user nova-compute[75020]:   <metadata>
Nov 30 11:50:50 user nova-compute[75020]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 11:50:50 user nova-compute[75020]:       <nova:package version="0.0.0"/>
Nov 30 11:50:50 user nova-compute[75020]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1823678634</nova:name>
Nov 30 11:50:50 user nova-compute[75020]:       <nova:creationTime>2023-11-30 11:50:50</nova:creationTime>
Nov 30 11:50:50 user nova-compute[75020]:       <nova:flavor name="m1.tiny">
Nov 30 11:50:50 user nova-compute[75020]:         <nova:memory>512</nova:memory>
Nov 30 11:50:50 user nova-compute[75020]:         <nova:disk>1</nova:disk>
Nov 30 11:50:50 user nova-compute[75020]:         <nova:swap>0</nova:swap>
Nov 30 11:50:50 user nova-compute[75020]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 11:50:50 user nova-compute[75020]:         <nova:vcpus>1</nova:vcpus>
Nov 30 11:50:50 user nova-compute[75020]:       </nova:flavor>
Nov 30 11:50:50 user nova-compute[75020]:       <nova:owner>
Nov 30 11:50:50 user nova-compute[75020]:         <nova:user uuid="2baf7d9e1413499ea1b27554f23d01fd">tempest-TestServerVolumeAttachmentScenario-475220594-project-member</nova:user>
Nov 30 11:50:50 user nova-compute[75020]:         <nova:project uuid="d8e609e714404de3923c5fa991ac3c74">tempest-TestServerVolumeAttachmentScenario-475220594</nova:project>
Nov 30 11:50:50 user nova-compute[75020]:       </nova:owner>
Nov 30 11:50:50 user nova-compute[75020]:       <nova:root type="image" uuid="a0e347bf-fa3a-4008-b934-b96aa4570396"/>
Nov 30 11:50:50 user nova-compute[75020]:       <nova:ports>
Nov 30 11:50:50 user nova-compute[75020]:         <nova:port uuid="4d1dfac5-57b0-4cf5-bb1b-6206417421aa">
Nov 30 11:50:50 user nova-compute[75020]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 11:50:50 user nova-compute[75020]:         </nova:port>
Nov 30 11:50:50 user nova-compute[75020]:       </nova:ports>
Nov 30 11:50:50 user nova-compute[75020]:     </nova:instance>
Nov 30 11:50:50 user nova-compute[75020]:   </metadata>
Nov 30 11:50:50 user nova-compute[75020]:   <sysinfo type="smbios">
Nov 30 11:50:50 user nova-compute[75020]:     <system>
Nov 30 11:50:50 user nova-compute[75020]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 11:50:50 user nova-compute[75020]:       <entry name="product">OpenStack Nova</entry>
Nov 30 11:50:50 user nova-compute[75020]:       <entry name="version">0.0.0</entry>
Nov 30 11:50:50 user nova-compute[75020]:       <entry name="serial">86b16353-8fed-48d9-b99b-e702a7fe3a7c</entry>
Nov 30 11:50:50 user nova-compute[75020]:       <entry name="uuid">86b16353-8fed-48d9-b99b-e702a7fe3a7c</entry>
Nov 30 11:50:50 user nova-compute[75020]:       <entry name="family">Virtual Machine</entry>
Nov 30 11:50:50 user nova-compute[75020]:     </system>
Nov 30 11:50:50 user nova-compute[75020]:   </sysinfo>
Nov 30 11:50:50 user nova-compute[75020]:   <os>
Nov 30 11:50:50 user nova-compute[75020]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 11:50:50 user nova-compute[75020]:     <boot dev="hd"/>
Nov 30 11:50:50 user nova-compute[75020]:     <smbios mode="sysinfo"/>
Nov 30 11:50:50 user nova-compute[75020]:   </os>
Nov 30 11:50:50 user nova-compute[75020]:   <features>
Nov 30 11:50:50 user nova-compute[75020]:     <acpi/>
Nov 30 11:50:50 user nova-compute[75020]:     <apic/>
Nov 30 11:50:50 user nova-compute[75020]:     <vmcoreinfo/>
Nov 30 11:50:50 user nova-compute[75020]:   </features>
Nov 30 11:50:50 user nova-compute[75020]:   <clock offset="utc">
Nov 30 11:50:50 user nova-compute[75020]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 11:50:50 user nova-compute[75020]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 11:50:50 user nova-compute[75020]:     <timer name="hpet" present="no"/>
Nov 30 11:50:50 user nova-compute[75020]:   </clock>
Nov 30 11:50:50 user nova-compute[75020]:   <cpu mode="custom" match="exact">
Nov 30 11:50:50 user nova-compute[75020]:     <model>Nehalem</model>
Nov 30 11:50:50 user nova-compute[75020]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 11:50:50 user nova-compute[75020]:   </cpu>
Nov 30 11:50:50 user nova-compute[75020]:   <devices>
Nov 30 11:50:50 user nova-compute[75020]:     <disk type="file" device="disk">
Nov 30 11:50:50 user nova-compute[75020]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 11:50:50 user nova-compute[75020]:       <source file="/opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk"/>
Nov 30 11:50:50 user nova-compute[75020]:       <target dev="vda" bus="virtio"/>
Nov 30 11:50:50 user nova-compute[75020]:     </disk>
Nov 30 11:50:50 user nova-compute[75020]:     <interface type="ethernet">
Nov 30 11:50:50 user nova-compute[75020]:       <mac address="fa:16:3e:ea:a4:26"/>
Nov 30 11:50:50 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:50:50 user nova-compute[75020]:       <mtu size="1442"/>
Nov 30 11:50:50 user nova-compute[75020]:       <target dev="tap4d1dfac5-57"/>
Nov 30 11:50:50 user nova-compute[75020]:     </interface>
Nov 30 11:50:50 user nova-compute[75020]:     <serial type="pty">
Nov 30 11:50:50 user nova-compute[75020]:       <log file="/opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/console.log" append="off"/>
Nov 30 11:50:50 user nova-compute[75020]:     </serial>
Nov 30 11:50:50 user nova-compute[75020]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 11:50:50 user nova-compute[75020]:     <video>
Nov 30 11:50:50 user nova-compute[75020]:       <model type="virtio"/>
Nov 30 11:50:50 user nova-compute[75020]:     </video>
Nov 30 11:50:50 user nova-compute[75020]:     <rng model="virtio">
Nov 30 11:50:50 user nova-compute[75020]:       <backend model="random">/dev/urandom</backend>
Nov 30 11:50:50 user nova-compute[75020]:     </rng>
Nov 30 11:50:50 user nova-compute[75020]:     <controller type="usb" index="0" model="none"/>
Nov 30 11:50:50 user nova-compute[75020]:     <memballoon model="virtio">
Nov 30 11:50:50 user nova-compute[75020]:       <stats period="10"/>
Nov 30 11:50:50 user nova-compute[75020]:     </memballoon>
Nov 30 11:50:50 user nova-compute[75020]:   </devices>
Nov 30 11:50:50 user nova-compute[75020]: </domain>
Nov 30 11:50:50 user nova-compute[75020]:  {{(pid=75020) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1823678634',display_name='tempest-TestServerVolumeAttachmentScenario-server-1823678634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1823678634',id=52,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKs/TsSPSADvAqhCRE6xckIZzDVI0T2zD8RTrgYHkgYPTagjCWUefCJ1uTNsU1k1zH25HHLx4LDVTLs6amBOcjO55CAMyVqWxJxQ5tnhObc2byyJoHQs6LzLLwso6sztOQ==',key_name='tempest-keypair-1469901248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8e609e714404de3923c5fa991ac3c74',ramdisk_id='',reservation_id='r-pqiz14k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-475220594',owner_user_name='tempest-TestServerVolumeAttachmentScenario-475220594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T11:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2baf7d9e1413499ea1b27554f23d01fd',uuid=86b16353-8fed-48d9-b99b-e702a7fe3a7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Converting VIF {"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=4d1dfac5-57b0-4cf5-bb1b-6206417421aa,network=Network(a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1dfac5-57') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG os_vif [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=4d1dfac5-57b0-4cf5-bb1b-6206417421aa,network=Network(a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1dfac5-57') {{(pid=75020) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd11b3504-19f1-5126-b5ae-25ddcf4494db', '_type': 'linux-noop'}}, row=False) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d1dfac5-57, may_exist=True, interface_attrs={}) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d1dfac5-57, col_values=(('qos', UUID('b7c3a5be-0c1a-4e05-ac00-41afafa1e9dc')),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d1dfac5-57, col_values=(('external_ids', {'iface-id': '4d1dfac5-57b0-4cf5-bb1b-6206417421aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a4:26', 'vm-uuid': '86b16353-8fed-48d9-b99b-e702a7fe3a7c'}),), if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:50 user nova-compute[75020]: INFO os_vif [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=4d1dfac5-57b0-4cf5-bb1b-6206417421aa,network=Network(a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1dfac5-57')
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No VIF found with MAC fa:16:3e:ea:a4:26, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-df72acf1-30a8-4712-9a6a-08a6388f6822 req-dbc4c026-fc1e-4461-9953-1b664d02873a service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updated VIF entry in instance network info cache for port 4d1dfac5-57b0-4cf5-bb1b-6206417421aa. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG nova.network.neutron [req-df72acf1-30a8-4712-9a6a-08a6388f6822 req-dbc4c026-fc1e-4461-9953-1b664d02873a service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating instance_info_cache with network_info: [{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:50:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-df72acf1-30a8-4712-9a6a-08a6388f6822 req-dbc4c026-fc1e-4461-9953-1b664d02873a service nova] Releasing lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:50:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:51 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-58bb038b-e6f1-4c59-988f-a026607f2054 req-5d85cd4a-369b-4b38-8eb5-b8ae2c2a461b service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received event network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:50:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58bb038b-e6f1-4c59-988f-a026607f2054 req-5d85cd4a-369b-4b38-8eb5-b8ae2c2a461b service nova] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58bb038b-e6f1-4c59-988f-a026607f2054 req-5d85cd4a-369b-4b38-8eb5-b8ae2c2a461b service nova] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-58bb038b-e6f1-4c59-988f-a026607f2054 req-5d85cd4a-369b-4b38-8eb5-b8ae2c2a461b service nova] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:51 user nova-compute[75020]: DEBUG nova.compute.manager [req-58bb038b-e6f1-4c59-988f-a026607f2054 req-5d85cd4a-369b-4b38-8eb5-b8ae2c2a461b service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] No waiting events found dispatching network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:50:51 user nova-compute[75020]: WARNING nova.compute.manager [req-58bb038b-e6f1-4c59-988f-a026607f2054 req-5d85cd4a-369b-4b38-8eb5-b8ae2c2a461b service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received unexpected event network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa for instance with vm_state building and task_state spawning.
Nov 30 11:50:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Instance event wait completed in 0 seconds for  {{(pid=75020) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Guest created on hypervisor {{(pid=75020) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 11:50:53 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Instance spawned successfully.
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Found default for hw_cdrom_bus of ide {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Found default for hw_disk_bus of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Found default for hw_input_bus of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Found default for hw_pointer_model of None {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Found default for hw_video_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Found default for hw_vif_model of virtio {{(pid=75020) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 11:50:53 user nova-compute[75020]: INFO nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Checking state {{(pid=75020) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 11:50:53 user nova-compute[75020]: INFO nova.compute.manager [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Took 6.05 seconds to build instance.
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-17c46f9d-fd77-4b6a-a077-92ef46da8114 req-0283d154-acbf-43bd-8367-22764402a696 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received event network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-17c46f9d-fd77-4b6a-a077-92ef46da8114 req-0283d154-acbf-43bd-8367-22764402a696 service nova] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-17c46f9d-fd77-4b6a-a077-92ef46da8114 req-0283d154-acbf-43bd-8367-22764402a696 service nova] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-17c46f9d-fd77-4b6a-a077-92ef46da8114 req-0283d154-acbf-43bd-8367-22764402a696 service nova] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:53 user nova-compute[75020]: DEBUG nova.compute.manager [req-17c46f9d-fd77-4b6a-a077-92ef46da8114 req-0283d154-acbf-43bd-8367-22764402a696 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] No waiting events found dispatching network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:50:53 user nova-compute[75020]: WARNING nova.compute.manager [req-17c46f9d-fd77-4b6a-a077-92ef46da8114 req-0283d154-acbf-43bd-8367-22764402a696 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received unexpected event network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa for instance with vm_state active and task_state None.
Nov 30 11:50:53 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0ebd0883-40e0-4558-bf2e-98d7424a5ac4 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.160s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:50:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:50:59 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:51:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:14 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:15 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:19 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:24 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:24 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:27 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:51:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:51:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:51:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:51:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:51:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:51:37 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:51:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.08321762084961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:51:37 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:51:38 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:51:38 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating instance_info_cache with network_info: [{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:51:40 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:44 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:51:44 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:51:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:51:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:51:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:51:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:51:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:51:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:51:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:51:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:52:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:52:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:52:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:52:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:52:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:52:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:25 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:52:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:52:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:29 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:52:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:52:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:52:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:38 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-14a334c1-c285-412b-b641-8ab635b74874 req-42e2d98a-b93c-4ccc-bc39-3a02f1cb5aab service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received event network-changed-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG nova.compute.manager [req-14a334c1-c285-412b-b641-8ab635b74874 req-42e2d98a-b93c-4ccc-bc39-3a02f1cb5aab service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Refreshing instance network info cache due to event network-changed-4d1dfac5-57b0-4cf5-bb1b-6206417421aa. {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14a334c1-c285-412b-b641-8ab635b74874 req-42e2d98a-b93c-4ccc-bc39-3a02f1cb5aab service nova] Acquiring lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14a334c1-c285-412b-b641-8ab635b74874 req-42e2d98a-b93c-4ccc-bc39-3a02f1cb5aab service nova] Acquired lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG nova.network.neutron [req-14a334c1-c285-412b-b641-8ab635b74874 req-42e2d98a-b93c-4ccc-bc39-3a02f1cb5aab service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Refreshing network info cache for port 4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:39 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.network.neutron [req-14a334c1-c285-412b-b641-8ab635b74874 req-42e2d98a-b93c-4ccc-bc39-3a02f1cb5aab service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updated VIF entry in instance network info cache for port 4d1dfac5-57b0-4cf5-bb1b-6206417421aa. {{(pid=75020) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.network.neutron [req-14a334c1-c285-412b-b641-8ab635b74874 req-42e2d98a-b93c-4ccc-bc39-3a02f1cb5aab service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating instance_info_cache with network_info: [{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:52:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:52:40 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=25.08251953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-14a334c1-c285-412b-b641-8ab635b74874 req-42e2d98a-b93c-4ccc-bc39-3a02f1cb5aab service nova] Releasing lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.objects.instance [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lazy-loading 'flavor' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:52:40 user nova-compute[75020]: INFO nova.compute.manager [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Attaching volume 6a59f9df-867e-4f51-a95f-e808d81e87d8 to /dev/vdb
Nov 30 11:52:40 user nova-compute[75020]: DEBUG os_brick.utils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[324150f8-2408-42cf-bd10-02add252a31d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb83b3c7-c098-4f7f-a5c2-4eabd6241f93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c4820-eedc-4a7d-8bc3-a6f4fb4ec27e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e421bc-9119-4ffb-be61-0f3091b5c7c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:52:40 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:52:40 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8249382-2653-4e7f-988f-84104e277b6a]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG os_brick.utils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:52:40 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating existing volume attachment record: 30d4b895-e197-498d-a1f8-bd80c8580619 {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating instance_info_cache with network_info: [{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:52:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:44 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:52:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:52:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:49 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJiuTzRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:52:52 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:52:52 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:52:52 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a363d8d-1693-4c43-a8e8-fa7c72ed4ffe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:52:52 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a262591-67c5-4ee6-bd46-94f0a681b2a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8] added
Nov 30 11:52:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c45c89-86e6-46c7-baff-8569fa7bb1e2]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a97c5b8-874f-4cb2-af0a-21ff069926b0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJiuTzRk {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJiuTzRk" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9968649-e988-4494-a6f3-3a80375cd719]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IJiuTzRk'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49de5bb-065b-4cd2-a85d-21149512bac3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ce741-f188-4121-98d3-759d3bcac12d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:52:52 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 11:52:52 user nova-compute[75020]:  {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:52:52 user nova-compute[75020]: WARNING os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 11:52:52 user nova-compute[75020]: 
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[09526695-0a76-46e0-9d4f-35031233dc3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8, portal: 172.16.0.220,3260]
Nov 30 11:52:52 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8, portal: 172.16.0.220,3260] successful.
Nov 30 11:52:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8332c24b-a3c7-4288-a4bc-1e1223c264c0]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b7a746-e78d-4ea5-b006-294b5b337faa]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:52:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:52:52 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5646db1d-6650-443a-b659-d5eb6919e39b]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:52 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJiuTzRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23133616234333731', 'path': '/dev/sdb'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133616234333731', 'path': '/dev/sdb'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG nova.objects.instance [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lazy-loading 'flavor' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:52:53 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:52:53 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:52:53 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:52:53 user nova-compute[75020]:   <serial>6a59f9df-867e-4f51-a95f-e808d81e87d8</serial>
Nov 30 11:52:53 user nova-compute[75020]: </disk>
Nov 30 11:52:53 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:52:53 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No VIF found with MAC fa:16:3e:ea:a4:26, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:52:54 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-79dadb14-c658-4fab-a6f3-a631a78ead86 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.527s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:52:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:52:56 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lazy-loading 'flavor' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:52:56 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:52:56 user nova-compute[75020]: INFO nova.compute.manager [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Attaching volume 8560c34a-de17-448d-a6c3-a8977dccdeb4 to /dev/vdc
Nov 30 11:52:57 user nova-compute[75020]: DEBUG os_brick.utils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b0048-7ed7-4837-9240-72c10b8b69c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:957375d81d3d\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c368df47-de50-40ed-8f98-e810d1e71d5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b9ec9f-e084-4569-95ab-ccecfcb3bc2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c838dbd-bca0-43c8-8562-2db32cd4c006]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Running cmd (subprocess): nvme version {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] 'nvme version' failed. Not Retrying. {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] nvme not present on system {{(pid=75020) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 11:52:57 user nova-compute[75020]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 11:52:57 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b4f528-7095-485a-b86c-ca0975a307c2]: (4, '') {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75020) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.lightos [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] LIGHTOS: no hostnqn found. {{(pid=75020) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG os_brick.utils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:957375d81d3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:52:57 user nova-compute[75020]: DEBUG nova.virt.block_device [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating existing volume attachment record: 0ef6af07-cacd-4fbf-b0f3-98ff9c6b5c9e {{(pid=75020) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 11:53:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:53:05 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Calling os-brick to attach iSCSI Volume {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 11:53:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRokzQfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:53:05 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:53:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:53:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:53:05 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:53:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:53:05 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:53:05 user nova-compute[75020]: INFO os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 11:53:05 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[03885120-b48a-41f6-99d3-8b77993db7ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 11:53:06 user nova-compute[75020]:  {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88fdb25-7fa9-4174-b2ad-82ba75e6b3cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4] added\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4] added
Nov 30 11:53:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[184306bf-754a-4361-9eba-ddde5937595d]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d1f53-4226-4169-9d71-fbc04e26f804]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRokzQfS {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRokzQfS" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed4faea-f7d4-448d-8ec7-6cd02f9874e5]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRokzQfS'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[948de083-c015-4cdb-8517-63c6c9f9d938]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c061ea3-934b-4c54-b5f8-3e455e43bc96]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:53:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:53:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --login {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[833a1687-d1ad-4437-9e31-32e4648fc5c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4, portal: 172.16.0.220,3260]
Nov 30 11:53:06 user nova-compute[75020]: Login to [iface: default, target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4, portal: 172.16.0.220,3260] successful.
Nov 30 11:53:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb14de4-fe12-4522-92d6-3dce839bcd44]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5e059f-e1a7-4bb7-a7a7-1ca8323d2d50]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:53:06 user nova-compute[75020]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 (non-flash)
Nov 30 11:53:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:53:06 user nova-compute[75020]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 (non-flash)
Nov 30 11:53:06 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Connected to 172.16.0.220:3260 {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75020) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75020) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6263142-31f8-4152-bb22-57263cf15a60]: (4, ('- - 0', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75020) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 11:53:06 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRokzQfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75020) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23165343631346432', 'path': '/dev/sdc'} {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165343631346432', 'path': '/dev/sdc'} {{(pid=75020) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG nova.objects.instance [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lazy-loading 'flavor' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 11:53:07 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:53:07 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:53:07 user nova-compute[75020]:   <target dev="vdc" bus="virtio"/>
Nov 30 11:53:07 user nova-compute[75020]:   <serial>8560c34a-de17-448d-a6c3-a8977dccdeb4</serial>
Nov 30 11:53:07 user nova-compute[75020]: </disk>
Nov 30 11:53:07 user nova-compute[75020]:  {{(pid=75020) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75020) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] No VIF found with MAC fa:16:3e:ea:a4:26, not building metadata {{(pid=75020) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 11:53:07 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-0cfd3098-8b35-42f2-89c4-7cce97b8e18b tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.912s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:53:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:53:09 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:53:09 user nova-compute[75020]: INFO nova.compute.manager [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Detaching volume 8560c34a-de17-448d-a6c3-a8977dccdeb4
Nov 30 11:53:09 user nova-compute[75020]: INFO nova.virt.block_device [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Attempting to driver detach volume 8560c34a-de17-448d-a6c3-a8977dccdeb4 from mountpoint /dev/vdc
Nov 30 11:53:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Attempting to detach device vdc from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:53:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:53:09 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:53:09 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:53:09 user nova-compute[75020]:   <target dev="vdc" bus="virtio"/>
Nov 30 11:53:09 user nova-compute[75020]:   <serial>8560c34a-de17-448d-a6c3-a8977dccdeb4</serial>
Nov 30 11:53:09 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 11:53:09 user nova-compute[75020]: </disk>
Nov 30 11:53:09 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:53:09 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Successfully detached device vdc from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c from the persistent domain config.
Nov 30 11:53:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:53:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:53:09 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:53:09 user nova-compute[75020]:   <source dev="/dev/sdc"/>
Nov 30 11:53:09 user nova-compute[75020]:   <target dev="vdc" bus="virtio"/>
Nov 30 11:53:09 user nova-compute[75020]:   <serial>8560c34a-de17-448d-a6c3-a8977dccdeb4</serial>
Nov 30 11:53:09 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 11:53:09 user nova-compute[75020]: </disk>
Nov 30 11:53:09 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:53:09 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:53:09 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:19 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:53:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:53:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:53:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:53:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:53:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:29 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c is timed out.
Nov 30 11:53:29 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Successfully detached device vdc from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c from the live domain config.
Nov 30 11:53:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRokzQfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:53:29 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee74511-0a28-4248-9ec0-c3e44114efab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:53:29 user nova-compute[75020]: No targets found.
Nov 30 11:53:29 user nova-compute[75020]: iSNS:
Nov 30 11:53:29 user nova-compute[75020]: No targets found.
Nov 30 11:53:29 user nova-compute[75020]: STATIC:
Nov 30 11:53:29 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8
Nov 30 11:53:29 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:53:29 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:53:29 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4
Nov 30 11:53:29 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:53:29 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:53:29 user nova-compute[75020]: FIRMWARE:
Nov 30 11:53:29 user nova-compute[75020]: No targets found.
Nov 30 11:53:29 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:53:29 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:53:29 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[881fdd8a-d7ca-463a-a511-d7290081691f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39196b8-2acb-4a02-a83c-9cf33e799f5d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:53:29 user nova-compute[75020]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 (non-flash)
Nov 30 11:53:29 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:53:29 user nova-compute[75020]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 (non-flash)
Nov 30 11:53:29 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fada8199b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4'): ({'sdc'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Removing single pathed devices sdc {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6524d98f-77d5-4f9f-8667-611872b49090]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d02d42e-1723-4234-89ea-4bde8227177e]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Flushing IO for device /dev/sdc {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384e7b1-eaed-4511-b545-a318b0e03ff3]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d982213c-71ab-4c09-b6c6-9d380e26c0cd]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] SCSI volumes sdc have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0efda00-d40c-4b39-ac9b-9ece45b442a1]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb75513-b1df-41a9-854b-8bb42e13dd4b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4, portal: 172.16.0.220,3260]
Nov 30 11:53:29 user nova-compute[75020]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4, portal: 172.16.0.220,3260] successful.
Nov 30 11:53:29 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8560c34a-de17-448d-a6c3-a8977dccdeb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e96071f-e381-4ca5-972e-c2490c885230]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] <== disconnect_volume: return (280ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:53:29 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:53:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:30 user nova-compute[75020]: DEBUG nova.objects.instance [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lazy-loading 'flavor' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:53:30 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-c54b8b5a-8f8f-4cb0-bd9c-1425a30ee7c1 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:53:30 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:53:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:39 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:53:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:53:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:53:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:53:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:53:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating instance_info_cache with network_info: [{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:41 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75020) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 11:53:42 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:53:42 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:53:42 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.080963134765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:53:42 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:53:43 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:53:47 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:53:47 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:53:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:53:59 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:53:59 user nova-compute[75020]: INFO nova.compute.manager [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Detaching volume 6a59f9df-867e-4f51-a95f-e808d81e87d8
Nov 30 11:53:59 user nova-compute[75020]: INFO nova.virt.block_device [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Attempting to driver detach volume 6a59f9df-867e-4f51-a95f-e808d81e87d8 from mountpoint /dev/vdb
Nov 30 11:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Attempting to detach device vdb from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c from the persistent domain config. {{(pid=75020) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 11:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:53:59 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:53:59 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:53:59 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:53:59 user nova-compute[75020]:   <serial>6a59f9df-867e-4f51-a95f-e808d81e87d8</serial>
Nov 30 11:53:59 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:53:59 user nova-compute[75020]: </disk>
Nov 30 11:53:59 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:53:59 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Successfully detached device vdb from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c from the persistent domain config.
Nov 30 11:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c from the live domain config. {{(pid=75020) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 11:53:59 user nova-compute[75020]: DEBUG nova.virt.libvirt.guest [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 11:53:59 user nova-compute[75020]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 11:53:59 user nova-compute[75020]:   <source dev="/dev/sdb"/>
Nov 30 11:53:59 user nova-compute[75020]:   <target dev="vdb" bus="virtio"/>
Nov 30 11:53:59 user nova-compute[75020]:   <serial>6a59f9df-867e-4f51-a95f-e808d81e87d8</serial>
Nov 30 11:53:59 user nova-compute[75020]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 11:53:59 user nova-compute[75020]: </disk>
Nov 30 11:53:59 user nova-compute[75020]:  {{(pid=75020) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 11:54:00 user nova-compute[75020]: DEBUG nova.virt.libvirt.driver [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 11:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:54:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:20 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c is timed out.
Nov 30 11:54:20 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Successfully detached device vdb from instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c from the live domain config.
Nov 30 11:54:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] calling os-brick to detach iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fada84dca60>, {'target_iqn': 'iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJiuTzRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 11:54:20 user nova-compute[75020]: WARNING os_brick.initiator.connectors.base [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c66baec-5857-4b98-963b-9663faf9fe12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 11:54:20 user nova-compute[75020]: No targets found.
Nov 30 11:54:20 user nova-compute[75020]: iSNS:
Nov 30 11:54:20 user nova-compute[75020]: No targets found.
Nov 30 11:54:20 user nova-compute[75020]: STATIC:
Nov 30 11:54:20 user nova-compute[75020]: Target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8
Nov 30 11:54:20 user nova-compute[75020]:         Portal: 172.16.0.220:3260,-1
Nov 30 11:54:20 user nova-compute[75020]:                 Iface Name: default
Nov 30 11:54:20 user nova-compute[75020]: FIRMWARE:
Nov 30 11:54:20 user nova-compute[75020]: No targets found.
Nov 30 11:54:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 11:54:20 user nova-compute[75020]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 11:54:20 user nova-compute[75020]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75020) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8', 0)] {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a1aa22-b782-41e4-95e5-54f39d15c693]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c24c4cf-2783-48dc-8598-7b2cefc5392b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:54:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 (non-flash)
Nov 30 11:54:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fad88600c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8'): ({'sdb'}, set())}) {{(pid=75020) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Removing single pathed devices sdb {{(pid=75020) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0c9cb9-02d8-48d8-b08f-e964e4c9ef99]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7209f896-9077-4edf-ba6a-0ca8c3906e43]: (4, ('ok\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Flushing IO for device /dev/sdb {{(pid=75020) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6995b06-28d8-421a-a744-c42aba35561c]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75020) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[565cf512-76d6-44a1-98f9-ebad0b489298]: (4, ('1', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.linuxscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] SCSI volumes sdb have been removed. {{(pid=75020) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8')] {{(pid=75020) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6224839-834c-411b-8d55-4fcc71c15c88]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --logout {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc88a82-88b8-4d64-95d4-8897fbacff69]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8, portal: 172.16.0.220,3260]
Nov 30 11:54:20 user nova-compute[75020]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8, portal: 172.16.0.220,3260] successful.
Nov 30 11:54:20 user nova-compute[75020]:  stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op delete {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a59f9df-867e-4f51-a95f-e808d81e87d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86371) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddde337-9db1-4812-97c2-76adacd1e03b]: (4, ('', '')) {{(pid=86371) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75020) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.base [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG os_brick.initiator.connectors.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] <== disconnect_volume: return (283ms) None {{(pid=75020) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 11:54:20 user nova-compute[75020]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Disconnected iSCSI Volume {{(pid=75020) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 11:54:21 user nova-compute[75020]: DEBUG nova.objects.instance [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lazy-loading 'flavor' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:54:21 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-31217868-b5d9-44f6-a222-b27211bf1552 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.865s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:54:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:54:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:54:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:40 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:54:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:54:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquired lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Forcefully refreshing network info cache for instance {{(pid=75020) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG nova.objects.instance [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lazy-loading 'info_cache' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG nova.network.neutron [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating instance_info_cache with network_info: [{"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Releasing lock "refresh_cache-86b16353-8fed-48d9-b99b-e702a7fe3a7c" {{(pid=75020) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 11:54:41 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updated the network info_cache for instance {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.processutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 11:54:43 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:54:43 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9023MB free_disk=25.08031463623047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75020) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:54:43 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing inventories for resource provider 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 11:54:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating ProviderTree inventory for provider 88367873-990b-4954-a4a6-b7b412a97446 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 11:54:44 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Updating inventory in ProviderTree for provider 88367873-990b-4954-a4a6-b7b412a97446 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 11:54:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing aggregate associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, aggregates: None {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 11:54:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Refreshing trait associations for resource provider 88367873-990b-4954-a4a6-b7b412a97446, traits: COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO {{(pid=75020) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 11:54:44 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:54:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:54:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:54:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:54:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:49 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:54:49 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:54:49 user nova-compute[75020]: INFO nova.compute.manager [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Terminating instance
Nov 30 11:54:49 user nova-compute[75020]: DEBUG nova.compute.manager [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Start destroying the instance on the hypervisor. {{(pid=75020) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75020) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-60d346ed-ac33-440d-b15b-5efb9c55c8ad req-82c2f0a2-e266-4f37-a638-bf7610ad1bc7 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received event network-vif-unplugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60d346ed-ac33-440d-b15b-5efb9c55c8ad req-82c2f0a2-e266-4f37-a638-bf7610ad1bc7 service nova] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60d346ed-ac33-440d-b15b-5efb9c55c8ad req-82c2f0a2-e266-4f37-a638-bf7610ad1bc7 service nova] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-60d346ed-ac33-440d-b15b-5efb9c55c8ad req-82c2f0a2-e266-4f37-a638-bf7610ad1bc7 service nova] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-60d346ed-ac33-440d-b15b-5efb9c55c8ad req-82c2f0a2-e266-4f37-a638-bf7610ad1bc7 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] No waiting events found dispatching network-vif-unplugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.compute.manager [req-60d346ed-ac33-440d-b15b-5efb9c55c8ad req-82c2f0a2-e266-4f37-a638-bf7610ad1bc7 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received event network-vif-unplugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa for instance with task_state deleting. {{(pid=75020) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: INFO nova.virt.libvirt.driver [-] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Instance destroyed successfully.
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.objects.instance [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lazy-loading 'resources' on Instance uuid 86b16353-8fed-48d9-b99b-e702a7fe3a7c {{(pid=75020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.virt.libvirt.vif [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T11:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1823678634',display_name='tempest-TestServerVolumeAttachmentScenario-server-1823678634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1823678634',id=52,image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKs/TsSPSADvAqhCRE6xckIZzDVI0T2zD8RTrgYHkgYPTagjCWUefCJ1uTNsU1k1zH25HHLx4LDVTLs6amBOcjO55CAMyVqWxJxQ5tnhObc2byyJoHQs6LzLLwso6sztOQ==',key_name='tempest-keypair-1469901248',keypairs=<?>,launch_index=0,launched_at=2023-11-30T11:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8e609e714404de3923c5fa991ac3c74',ramdisk_id='',reservation_id='r-pqiz14k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a0e347bf-fa3a-4008-b934-b96aa4570396',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-475220594',owner_user_name='tempest-TestServerVolumeAttachmentScenario-475220594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T11:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2baf7d9e1413499ea1b27554f23d01fd',uuid=86b16353-8fed-48d9-b99b-e702a7fe3a7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Converting VIF {"id": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "address": "fa:16:3e:ea:a4:26", "network": {"id": "a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-361460499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8e609e714404de3923c5fa991ac3c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1dfac5-57", "ovs_interfaceid": "4d1dfac5-57b0-4cf5-bb1b-6206417421aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.network.os_vif_util [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=4d1dfac5-57b0-4cf5-bb1b-6206417421aa,network=Network(a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1dfac5-57') {{(pid=75020) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG os_vif [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=4d1dfac5-57b0-4cf5-bb1b-6206417421aa,network=Network(a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1dfac5-57') {{(pid=75020) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d1dfac5-57, bridge=br-int, if_exists=True) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7c3a5be-0c1a-4e05-ac00-41afafa1e9dc) {{(pid=75020) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:54:50 user nova-compute[75020]: INFO os_vif [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=4d1dfac5-57b0-4cf5-bb1b-6206417421aa,network=Network(a7a6b3d0-0e7c-480c-8fec-7e4bb57ae79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d1dfac5-57')
Nov 30 11:54:50 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Deleting instance files /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c_del
Nov 30 11:54:50 user nova-compute[75020]: INFO nova.virt.libvirt.driver [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Deletion of /opt/stack/data/nova/instances/86b16353-8fed-48d9-b99b-e702a7fe3a7c_del complete
Nov 30 11:54:50 user nova-compute[75020]: INFO nova.compute.manager [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 30 11:54:50 user nova-compute[75020]: DEBUG oslo.service.loopingcall [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75020) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.compute.manager [-] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Deallocating network for instance {{(pid=75020) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 11:54:50 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] deallocate_for_instance() {{(pid=75020) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 11:54:51 user nova-compute[75020]: DEBUG nova.network.neutron [-] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Updating instance_info_cache with network_info: [] {{(pid=75020) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 11:54:51 user nova-compute[75020]: INFO nova.compute.manager [-] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Took 0.78 seconds to deallocate network for instance.
Nov 30 11:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:54:51 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:54:51 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:54:51 user nova-compute[75020]: INFO nova.scheduler.client.report [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Deleted allocations for instance 86b16353-8fed-48d9-b99b-e702a7fe3a7c
Nov 30 11:54:51 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-3b2f15eb-0a17-424f-9a26-9f57e21e2cc3 tempest-TestServerVolumeAttachmentScenario-475220594 tempest-TestServerVolumeAttachmentScenario-475220594-project-member] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:54:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-00d4c98a-756d-4b09-9aae-76299189f71b req-3f8c5f54-f123-4267-b14c-bec113af6b98 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received event network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:54:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-00d4c98a-756d-4b09-9aae-76299189f71b req-3f8c5f54-f123-4267-b14c-bec113af6b98 service nova] Acquiring lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:54:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-00d4c98a-756d-4b09-9aae-76299189f71b req-3f8c5f54-f123-4267-b14c-bec113af6b98 service nova] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:54:52 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [req-00d4c98a-756d-4b09-9aae-76299189f71b req-3f8c5f54-f123-4267-b14c-bec113af6b98 service nova] Lock "86b16353-8fed-48d9-b99b-e702a7fe3a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:54:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-00d4c98a-756d-4b09-9aae-76299189f71b req-3f8c5f54-f123-4267-b14c-bec113af6b98 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] No waiting events found dispatching network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 11:54:52 user nova-compute[75020]: WARNING nova.compute.manager [req-00d4c98a-756d-4b09-9aae-76299189f71b req-3f8c5f54-f123-4267-b14c-bec113af6b98 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received unexpected event network-vif-plugged-4d1dfac5-57b0-4cf5-bb1b-6206417421aa for instance with vm_state deleted and task_state None.
Nov 30 11:54:52 user nova-compute[75020]: DEBUG nova.compute.manager [req-00d4c98a-756d-4b09-9aae-76299189f71b req-3f8c5f54-f123-4267-b14c-bec113af6b98 service nova] [instance: 86b16353-8fed-48d9-b99b-e702a7fe3a7c] Received event network-vif-deleted-4d1dfac5-57b0-4cf5-bb1b-6206417421aa {{(pid=75020) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 11:54:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:55:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:12 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:20 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:26 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:28 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Cleaning up deleted instances {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 11:55:31 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] There are 0 instances to clean {{(pid=75020) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 11:55:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:36 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:41 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:43 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:55:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:55:43 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:55:44 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:55:44 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:55:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9155MB free_disk=25.10750961303711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:55:44 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:55:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:50 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:55:50 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:55:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:55:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:55:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:55:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:55:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:52 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:54 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:55:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:56:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:56:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:56:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:56:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:56:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:56:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:56:29 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:56:32 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:35 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:56:37 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:40 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:56:42 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:44 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:45 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Starting heal instance info cache {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 11:56:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Rebuilding the list of instances to heal {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 11:56:45 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Didn't find any instances for network info cache update. {{(pid=75020) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 11:56:45 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Auditing locally available compute resources for user (node: user) {{(pid=75020) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 11:56:46 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:56:46 user nova-compute[75020]: WARNING nova.virt.libvirt.driver [None req-18b972fb-c592-44b9-b596-7f406021deff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 11:56:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Hypervisor/Node resource view: name=user free_ram=9150MB free_disk=25.09780502319336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75020) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75020) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG nova.compute.provider_tree [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed in ProviderTree for provider: 88367873-990b-4954-a4a6-b7b412a97446 {{(pid=75020) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG nova.scheduler.client.report [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Inventory has not changed for provider 88367873-990b-4954-a4a6-b7b412a97446 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75020) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG nova.compute.resource_tracker [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Compute_service record updated for user:user {{(pid=75020) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 11:56:46 user nova-compute[75020]: DEBUG oslo_concurrency.lockutils [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=75020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 11:56:50 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:56:52 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:56:52 user nova-compute[75020]: DEBUG nova.compute.manager [None req-18b972fb-c592-44b9-b596-7f406021deff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75020) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 11:56:55 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:57:00 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:57:05 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:57:10 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:57:12 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:57:15 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:57:20 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:57:22 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:57:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:57:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 11:57:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75020) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 11:57:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:57:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75020) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 11:57:25 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:57:30 user nova-compute[75020]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75020) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 11:57:31 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 11:57:34 user nova-compute[75020]: DEBUG oslo_service.periodic_task [None req-18b972fb-c592-44b9-b596-7f406021deff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}